-- Logs begin at Wed 2022-08-24 09:08:31 UTC, end at Wed 2022-08-24 10:19:29 UTC. -- Aug 24 09:51:15.764556 dv-osbrick-836057-6-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 09:51:15.779508 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 09:51:15 2022] *** Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: nodename: dv-osbrick-836057-6-ceph Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: machine: x86_64 Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: clock source: unix Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: pcre jit disabled Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: detected number of CPU cores: 4 Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: current working directory: / Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: detected binary path: /usr/bin/uwsgi-core Aug 24 09:51:15.782515 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: your processes number limit is 47680 Aug 24 09:51:15.784299 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: your memory page size is 4096 bytes Aug 24 09:51:15.784299 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: detected max file descriptor number: 2048 Aug 24 09:51:15.784299 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: lock engine: pthread robust mutexes Aug 24 09:51:15.784299 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: thunder lock: enabled Aug 24 09:51:15.784299 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 09:51:15.784299 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 09:51:15.827968 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: Python main interpreter initialized at 0x564c2b5529c0 Aug 24 09:51:15.827968 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: python threads support enabled Aug 24 09:51:15.827968 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: your server socket listen backlog is limited to 100 connections Aug 24 09:51:15.827968 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: your mercy for graceful operations on workers is 90 seconds Aug 24 09:51:15.828436 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 09:51:15.828436 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: *** Operational MODE: preforking *** Aug 24 09:51:15.828721 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: *** uWSGI is running in multiple interpreter mode *** Aug 24 09:51:15.828721 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: spawned uWSGI master process (pid: 88294) Aug 24 09:51:15.828885 dv-osbrick-836057-6-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 24 09:51:15.829962 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: spawned uWSGI worker 1 (pid: 88305, cores: 1) Aug 24 09:51:15.829962 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: spawned uWSGI worker 2 (pid: 88306, cores: 1) Aug 24 09:51:15.829962 dv-osbrick-836057-6-ceph devstack@keystone.service[88294]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 09:51:20.594120 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:51:20.594120 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: from cryptography.utils import int_from_bytes Aug 24 09:51:20.595301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:51:20.595301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: from cryptography.utils import int_from_bytes Aug 24 09:51:20.647167 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:51:20.647434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:51:20.647579 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] command line args: [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:51:20.647789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:51:20.647965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ================================================================================ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:51:20.648207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] admin_token = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.648454 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] config_dir = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.648617 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.648836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] config_source = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.649015 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] debug = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.649216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.649589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.649767 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.650012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.650261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.650494 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.650666 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_config_append = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.650846 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.651028 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_dir = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.651214 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_file = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.651478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.651666 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.651921 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.652248 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.652400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.652520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.652805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.653019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.653253 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.653488 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.653725 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.653958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.654210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.654521 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.654746 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.655245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.655405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] publish_errors = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.655698 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.655907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.656104 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.656285 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.656510 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.656770 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] standard_threads = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.657006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.657250 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.657425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.657600 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_journal = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.657777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_json = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.657955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_stderr = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.658132 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] use_syslog = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.658363 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.658656 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.658893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.659158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.659397 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.659646 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.659886 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.660133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.660372 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.660620 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.660893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.661148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.661383 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.661635 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.661870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.662117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.662362 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.662600 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.662853 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.663106 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.663351 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.663585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.663838 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.664103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.664252 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:51:20.664252 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: from cryptography.utils import int_from_bytes Aug 24 09:51:20.665151 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.665278 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:51:20.665278 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: from cryptography.utils import int_from_bytes Aug 24 09:51:20.665524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.665524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.665524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.665524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.665524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.666076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.666076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.666355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.666493 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.666657 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.666908 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.667148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.667396 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.667626 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.667864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.668101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.668334 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.668567 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.668836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.669067 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.669347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.669563 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.669797 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.670039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.670270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.670510 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.670748 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.670997 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.671228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.671469 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.671711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.671950 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.672190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.672430 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.672737 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.672939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.673180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.673421 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.673656 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.673919 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.674685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.674922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.675165 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.675404 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.675678 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.675918 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.676169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.676452 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.676697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.676940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.677231 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.677392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.677622 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.677862 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.678109 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.678352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.678592 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.678828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.679782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.679782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.679782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.679782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.680267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.680267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.680504 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.680740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.680960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.681200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.681433 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.681663 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.681896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.682133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.682362 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.682605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.682841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.683091 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.683328 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.683582 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.683841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.684081 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.684312 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.external = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.684542 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.684866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.685099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.685330 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.password = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.685562 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] auth.token = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.685802 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.686040 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.686291 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.686523 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.686772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.687022 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.687253 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.687488 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.687890 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.688148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.688398 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.688640 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.688914 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.689153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.689410 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.689667 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.690484 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.690742 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.691035 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.691287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.691535 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.691792 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.692049 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.692288 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.692529 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.692806 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.693057 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.693292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.693544 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.693785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.694043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.694282 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.694546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.694781 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.695031 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.695271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.695524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.695775 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.696015 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.696259 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.696512 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.696794 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.697035 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.697290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.697567 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.697779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.698002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.698235 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.698484 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.698732 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.698980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.699238 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.699484 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.699757 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.699999 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.700237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.700471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.700737 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.700974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.701211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.701455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.701695 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.701946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.702179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.702430 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.702679 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.702914 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.703162 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.703411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.703642 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.703885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.704115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.704351 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.704591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.704946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.705096 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.705328 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.705626 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.705876 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.706110 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.706347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.706596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.706845 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.707079 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.707315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.707551 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.707782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.708022 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.708283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.708514 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.708785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.709035 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.709282 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.709516 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.709747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.709980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.710215 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.710454 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.710685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.710933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.711180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.711427 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.711675 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.711919 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.712149 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.712397 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.712635 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.712896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.713135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.713371 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.713618 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.713865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.714105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.714241 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:51:20.714376 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.714503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:51:20.714678 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.714871 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] command line args: [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:51:20.715005 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.715134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:51:20.715134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ================================================================================ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:51:20.715378 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.715378 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.715617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] admin_token = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.715742 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.715898 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] config_dir = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.715898 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.716152 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.716282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] config_source = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.716425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.716562 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] debug = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.716822 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.716951 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.717107 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.717253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.717253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.717488 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.717615 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.717990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.718113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.718251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.718385 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.718518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.718652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_config_append = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.718784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.718908 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.719054 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.719190 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_dir = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.719190 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_file = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.719419 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.719546 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.719676 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.719817 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.719946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.720123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.720265 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.720385 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.720501 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] role.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.720622 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.720835 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] role.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.720973 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.721097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.721211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.721343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.721474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.721617 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.721742 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.721854 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.721979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.722109 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.722237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.722379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.722510 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.722643 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.722775 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.722909 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.723043 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.723191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.723399 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.723538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.723538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.723782 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.723922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.724053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] publish_errors = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.724053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.724290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.724422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.724568 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.724737 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.724737 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.724956 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.725074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.725216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.725350 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] standard_threads = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.725471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.725591 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.725713 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.725833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.725953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.726086 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.726214 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.726339 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_journal = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.726339 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_json = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.726559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.726681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_stderr = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.726681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] use_syslog = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.726913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.727032 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:51:20.727153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.727283 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.727428 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.727560 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.727693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.727693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.727931 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.728061 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.728202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.728326 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.728454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.728454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.728699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.728831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.728979 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.729114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.729249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.729380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.729498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.729498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.729721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.729857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.729992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.730121 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.730253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.730401 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.730547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.730682 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.730809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.730935 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.731062 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.731194 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.731399 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.731535 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.731663 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.731792 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.731927 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.732063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.732210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.732345 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.732476 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.732608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.732771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.732905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.733043 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.733171 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.733287 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.733404 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.733528 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.733658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.733800 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.733916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.734045 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.734186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.734321 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.734455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.734600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.734734 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.734881 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.735020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.735148 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.735283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.735417 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.735653 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.735790 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.735922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.736056 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.736183 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.736312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.736455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.736598 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.737320 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.737453 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.737585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.737706 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.737840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.737958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.738080 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.738199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.738318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.738438 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.738568 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.738687 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.738815 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.738951 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739072 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739436 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739436 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739632 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739742 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739839 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.739968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740274 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.740380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.741233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742607 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742607 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742787 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.742954 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.743203 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.743446 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.743686 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.743933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.744175 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.744415 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.744765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.744909 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.745142 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.745407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.745652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.745893 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.746133 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.746376 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.746615 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.746854 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.747092 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.747324 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.747560 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.747792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.748029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.748269 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.748516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.748777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.749034 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.749274 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.749531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.749793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.750035 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.750270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.external = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.750500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.750798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.751030 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.751262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.password = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.751495 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] auth.token = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.753088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.753088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.753088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.753088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.753547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.753547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.753805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.753902 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.754158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.754413 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.754671 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.754909 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.755161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.755396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.755661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.755918 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.756155 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.756408 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.756870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.757128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.757401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.757654 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.757917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.758159 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.758401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.758651 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.758902 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.759143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.759398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.759638 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.759897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.760138 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.760395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.760634 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.760909 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.761148 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.761399 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.761646 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.761890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.762129 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.762379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.762616 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.762858 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.763109 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.763363 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.763598 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.763832 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.764068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.764315 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.764565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.764836 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.765094 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.765345 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.765617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.765860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.766098 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.766331 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.766568 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.766803 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.767039 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.767175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.767313 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.767449 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.767580 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.767723 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.767896 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.768030 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.768244 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.768493 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.768753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.769004 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.769254 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.769527 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.769726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.769937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.770179 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.770418 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.770666 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.770905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.771143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.771394 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.771644 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.771874 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.772105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.772354 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.772602 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.772862 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.773100 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.773338 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.773571 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.773813 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.774074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.774307 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.774556 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.774804 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.775051 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.775286 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.775518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.776201 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.776201 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.776201 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.776768 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.776886 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.777126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.777126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.777126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.777800 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.777800 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.778142 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.778142 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.778480 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.778703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.778973 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.779160 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.779617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.779617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.779936 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.780264 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.780451 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.780636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.780843 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.781011 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.781268 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.781530 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.781975 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.782114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.782282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.782513 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.782753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.782974 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.783215 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.783651 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.783984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.784340 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.784728 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.785130 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.785491 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.785838 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] role.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.786196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] role.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.786543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.786910 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.787279 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.787641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.788000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.788359 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.788754 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.789116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.789490 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.789819 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.790162 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.790506 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.790848 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.791190 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.791723 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.792053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.792395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.792783 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.793128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.793474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.793811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.794158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.794539 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.794876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.795202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.795527 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.795860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.796205 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.796556 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.796950 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.797283 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.797613 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.797949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.798279 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.798613 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.798952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.799821 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.800172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.800520 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.800887 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.801230 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.801568 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.801909 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.802244 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.802587 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.802916 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.803255 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.803600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.803923 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.804258 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.804728 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.805086 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.805439 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.805788 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.806121 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.806457 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.806786 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.807122 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.807453 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.807784 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.808125 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.808272 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.808492 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.808652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.808948 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.809279 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.809619 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.809953 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.810294 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.810627 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.810961 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.811290 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:51:20.811547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:51:20.838253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.838593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.838922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.850710 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.863882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.872908 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.873198 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.914866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.915103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.916550 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.953214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.953489 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.984867 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.985122 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.985370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.985525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.985731 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.985979 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.998500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.998748 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.998934 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.999156 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.999373 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:20.999587 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.010816 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.011060 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.011262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.011486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.011707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.011925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.012146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.013559 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.013792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.014013 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.014236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.014452 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.014807 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.014969 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.023732 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.026134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.037741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.038049 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.038233 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.038403 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.038543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.038687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.038826 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.038974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.039134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.039274 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.039414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.039414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.039655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.039800 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:51:21.056836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.057092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:51:21.057312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.057461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.057610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:51:21.057786 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:51:21.057930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.058030 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.058098 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:51:21.058161 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.058234 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.058310 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.058472 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.058569 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.058741 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.059002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.068132 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.068419 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.068600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.068784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.068928 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.069099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.069244 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.069385 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.075994 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.076373 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.078949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.079239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.079388 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.079523 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.079616 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.079814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.080000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.080113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.080200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.080408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.080496 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.080700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.080798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.080982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.081079 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.081257 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.081354 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.081529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.081708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.081853 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.081994 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.082150 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.107104 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.107357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.108523 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.108732 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.108882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.109057 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.114112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.114315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.114450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.114598 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.114761 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.114927 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.121240 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.121439 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.121591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.121738 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.125651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.125857 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.126007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.126144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.126280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.126435 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.126565 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.126707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.126849 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.126992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.127176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.127367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.127497 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.127626 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.127767 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.128000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.143454 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.143699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.143841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.143980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.147653 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.147851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.150804 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.150972 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.151104 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.151233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.155511 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.155698 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.159201 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.159325 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.162382 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.162589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.162741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.162886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.163018 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.163157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.163293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.163445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.163584 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.163722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.163913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.164061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.180282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.180546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.180730 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.180860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.180860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.181150 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.181299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.181444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.187850 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.188042 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.189571 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.189761 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.190076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.190231 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.192529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.192734 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.192913 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.193052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.193196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.193335 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.193475 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.193627 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.193766 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.193905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.205046 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.205283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.205484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.205631 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.205783 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.205925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.206066 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.206226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.206370 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.206510 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.206647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.206786 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.206940 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.207080 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.223066 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.223317 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.226070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.226278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.229128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.229298 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.230551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.230716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.232041 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.232320 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.232467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.232609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.232780 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.232917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.239714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.239924 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.241242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.241405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.244120 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.244325 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.244476 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.244621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.244805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.244944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.245070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.245230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.254161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.254405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.254627 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.254776 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.254951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.255097 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.261552 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.261766 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:51:21.261962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.262117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.262278 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.262424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.262567 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.262709 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.262851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.263006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.263142 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.263280 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.263417 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.263554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.263732 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.263872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.264009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.264164 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.264164 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.264444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.264588 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.264761 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.264916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.265055 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.265206 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.265340 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.265475 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.265612 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:51:21.298608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c2b5529c0 pid: 88306 (default app) Aug 24 09:51:21.298904 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c2b5529c0 pid: 88305 (default app) Aug 24 09:51:21.302911 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63d4a-8ebb-47f4-85cb-039ee2ae710f None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.303199 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63d4a-8ebb-47f4-85cb-039ee2ae710f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.303478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63d4a-8ebb-47f4-85cb-039ee2ae710f None None] PATH_INFO: `/v3` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.307753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Wed Aug 24 09:51:21 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:28.743044 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64335d-f52c-49ed-9bd6-34a4ddcb711d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:28.743715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64335d-f52c-49ed-9bd6-34a4ddcb711d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:28.743715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64335d-f52c-49ed-9bd6-34a4ddcb711d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:28.747903 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:51:28.754095 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:28.754651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:28.754763 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:28.832615 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: INFO dbcounter [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] Registered counter for database keystone Aug 24 09:51:28.853359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG oslo_db.sqlalchemy.engines [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:51:28.860347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writer thread running {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:51:29.047977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG passlib.handlers.bcrypt [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88306) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 09:51:29.048382 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG passlib.handlers.bcrypt [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88306) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 09:51:29.105122 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:29.106808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:29.248317 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 09:51:29.793473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64335d-f52c-49ed-9bd6-34a4ddcb711d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:29.870439 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: INFO dbcounter [None req-5c64335d-f52c-49ed-9bd6-34a4ddcb711d None None] Registered counter for database keystone Aug 24 09:51:29.893851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG oslo_db.sqlalchemy.engines [None req-5c64335d-f52c-49ed-9bd6-34a4ddcb711d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:51:29.901004 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writer thread running {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:51:30.030900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64335d-f52c-49ed-9bd6-34a4ddcb711d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:30.036307 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e4068-7203-437a-a75e-705c8429e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:30.037054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e4068-7203-437a-a75e-705c8429e7bf admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:30.037779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e4068-7203-437a-a75e-705c8429e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:30.037779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e4068-7203-437a-a75e-705c8429e7bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:30.049848 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e4068-7203-437a-a75e-705c8429e7bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:30.101741 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING keystone.common.rbac_enforcer.enforcer [None req-054e4068-7203-437a-a75e-705c8429e7bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 09:51:30.102082 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e4068-7203-437a-a75e-705c8429e7bf admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:30.113647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Wed Aug 24 09:51:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:51:30.119976 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:30.137705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3afb08-d1f9-4898-a553-28200dc9248a None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:30.142544 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa738803-7535-4048-a6ce-6e04168b0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:30.143704 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa738803-7535-4048-a6ce-6e04168b0284 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:30.143991 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa738803-7535-4048-a6ce-6e04168b0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:30.144299 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa738803-7535-4048-a6ce-6e04168b0284 admin admin] PATH_INFO: `/v3/projects/928770adba0b40bd87bea18febe221ea` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:30.145834 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa738803-7535-4048-a6ce-6e04168b0284 admin admin] RBAC: Authorizing `identity:get_project(project_id=928770adba0b40bd87bea18febe221ea)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:30.196278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fa738803-7535-4048-a6ce-6e04168b0284 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 09:51:30.196623 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa738803-7535-4048-a6ce-6e04168b0284 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:30.201459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Wed Aug 24 09:51:30 2022] GET /identity/v3/projects/928770adba0b40bd87bea18febe221ea => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:32.439251 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663383fb-e617-478f-9bab-95d0ee805f4a None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.439251 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663383fb-e617-478f-9bab-95d0ee805f4a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.439251 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663383fb-e617-478f-9bab-95d0ee805f4a None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.443087 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:51:32.451995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05e009-a86f-459d-8d7e-77426b7b205d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.452613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05e009-a86f-459d-8d7e-77426b7b205d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.452613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05e009-a86f-459d-8d7e-77426b7b205d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.474813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fb05e009-a86f-459d-8d7e-77426b7b205d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:32.476391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fb05e009-a86f-459d-8d7e-77426b7b205d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:32.484576 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 09:51:32.814674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663383fb-e617-478f-9bab-95d0ee805f4a None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:32.827404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663383fb-e617-478f-9bab-95d0ee805f4a None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:32.832487 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc903ee-ec6c-46a7-a4f6-52889ebff104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:32.833143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc903ee-ec6c-46a7-a4f6-52889ebff104 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.833433 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc903ee-ec6c-46a7-a4f6-52889ebff104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.833711 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc903ee-ec6c-46a7-a4f6-52889ebff104 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.843097 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc903ee-ec6c-46a7-a4f6-52889ebff104 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:32.844968 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc903ee-ec6c-46a7-a4f6-52889ebff104 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:32.856215 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Wed Aug 24 09:51:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:51:32.862147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05e009-a86f-459d-8d7e-77426b7b205d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:32.871961 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05e009-a86f-459d-8d7e-77426b7b205d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:32.876556 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff017fad-c889-4fe6-91d6-fe4da1316adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:32.877293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017fad-c889-4fe6-91d6-fe4da1316adc admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.877574 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017fad-c889-4fe6-91d6-fe4da1316adc admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.877847 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017fad-c889-4fe6-91d6-fe4da1316adc admin admin] PATH_INFO: `/v3/users/4e344534c0524c1e81232c0c48cd6c1f` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.879229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff017fad-c889-4fe6-91d6-fe4da1316adc admin admin] RBAC: Authorizing `identity:get_user(user_id=4e344534c0524c1e81232c0c48cd6c1f)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:32.881141 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff017fad-c889-4fe6-91d6-fe4da1316adc admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:32.882744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Wed Aug 24 09:51:32 2022] GET /identity/v3/users/4e344534c0524c1e81232c0c48cd6c1f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:35.228062 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce08d1-5dc9-4682-b723-80c774ddfc48 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.228593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce08d1-5dc9-4682-b723-80c774ddfc48 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.228949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce08d1-5dc9-4682-b723-80c774ddfc48 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.231313 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:35.240786 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399d19a-fea7-4362-aa68-5d0e88f94880 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.241333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399d19a-fea7-4362-aa68-5d0e88f94880 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.241758 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399d19a-fea7-4362-aa68-5d0e88f94880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.265338 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494d25-c76c-42d7-8a63-5ea5ca9c04cb None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.265618 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494d25-c76c-42d7-8a63-5ea5ca9c04cb None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.265881 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494d25-c76c-42d7-8a63-5ea5ca9c04cb None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.267222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:51:35.270747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-7399d19a-fea7-4362-aa68-5d0e88f94880 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:35.272171 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-7399d19a-fea7-4362-aa68-5d0e88f94880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:35.274153 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.274635 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.275104 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.354149 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG passlib.handlers.bcrypt [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88305) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 09:51:35.354852 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG passlib.handlers.bcrypt [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88305) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 09:51:35.409371 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:35.411849 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:35.475896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:51:35.593517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:51:35.806623 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399d19a-fea7-4362-aa68-5d0e88f94880 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:35.851777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:35.927410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:35.948153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399d19a-fea7-4362-aa68-5d0e88f94880 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:35.988289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aab3cc-f50e-479c-8824-6091f0805bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:35.989053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aab3cc-f50e-479c-8824-6091f0805bf8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.989334 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aab3cc-f50e-479c-8824-6091f0805bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.989615 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aab3cc-f50e-479c-8824-6091f0805bf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.003745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aab3cc-f50e-479c-8824-6091f0805bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-00aab3cc-f50e-479c-8824-6091f0805bf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:51:36.012938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:36.014865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:51:36.016546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:51:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:51:36.020936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aab3cc-f50e-479c-8824-6091f0805bf8 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.096395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879501d-06f3-4ccc-9e0c-2dfff504a348 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.100495 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:36.135812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:36.150270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559c27-cea1-455d-93a4-3a315c7966c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.151495 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559c27-cea1-455d-93a4-3a315c7966c1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.151929 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559c27-cea1-455d-93a4-3a315c7966c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.152272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11559c27-cea1-455d-93a4-3a315c7966c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.161131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aab3cc-f50e-479c-8824-6091f0805bf8 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.202218 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.203009 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.203404 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.203831 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.204692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:36.205661 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.207293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.233431 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:36.235178 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.247233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559c27-cea1-455d-93a4-3a315c7966c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.249714 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11559c27-cea1-455d-93a4-3a315c7966c1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.373445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97295c0-03ef-4c75-bec6-1ac179af4167 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.379364 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:36.385144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559c27-cea1-455d-93a4-3a315c7966c1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.388440 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:36.434594 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a09262-9702-44a3-b2b9-ad3090f72fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.435232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09262-9702-44a3-b2b9-ad3090f72fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.435514 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09262-9702-44a3-b2b9-ad3090f72fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.435794 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09262-9702-44a3-b2b9-ad3090f72fd6 None admin] PATH_INFO: `/v3/users/4e344534c0524c1e81232c0c48cd6c1f` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.437009 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a09262-9702-44a3-b2b9-ad3090f72fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=4e344534c0524c1e81232c0c48cd6c1f)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.438487 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a09262-9702-44a3-b2b9-ad3090f72fd6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.440731 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/users/4e344534c0524c1e81232c0c48cd6c1f => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:36.449689 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a09262-9702-44a3-b2b9-ad3090f72fd6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.473785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:36.511158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11559c27-cea1-455d-93a4-3a315c7966c1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.563889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.565649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.566107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.566564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.591221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.593331 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.598236 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a09262-9702-44a3-b2b9-ad3090f72fd6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:51:36.623261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:36.625146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:51:36.626704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:51:36.626704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:51:36.626704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:51:36.626704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:51:36.633195 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.651263 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc247d0-e6a3-4749-b29a-218f6bc83ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.652165 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc247d0-e6a3-4749-b29a-218f6bc83ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.652610 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc247d0-e6a3-4749-b29a-218f6bc83ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.653086 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc247d0-e6a3-4749-b29a-218f6bc83ff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.654964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc247d0-e6a3-4749-b29a-218f6bc83ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.657933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc247d0-e6a3-4749-b29a-218f6bc83ff6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.660608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:36.667578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc247d0-e6a3-4749-b29a-218f6bc83ff6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.786663 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:36.810582 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc247d0-e6a3-4749-b29a-218f6bc83ff6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.847851 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43db0a-f323-4a25-80e8-acf91f915cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.848471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43db0a-f323-4a25-80e8-acf91f915cdc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.848788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43db0a-f323-4a25-80e8-acf91f915cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.849064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43db0a-f323-4a25-80e8-acf91f915cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.849884 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43db0a-f323-4a25-80e8-acf91f915cdc None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.domain.id=default, user.id=4e344534c0524c1e81232c0c48cd6c1f) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:36.850189 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43db0a-f323-4a25-80e8-acf91f915cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.851655 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43db0a-f323-4a25-80e8-acf91f915cdc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.855631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:36.861885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 11/20] 10.222.0.70 () {56 vars in 1322 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/role_assignments?user.id=4e344534c0524c1e81232c0c48cd6c1f&scope.domain.id=default&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 233 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:36.925796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7f6e9-2491-4de6-bd7a-66185da344fd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.990384 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb7997-b6e6-4b35-9871-8c17dd3557f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.991404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb7997-b6e6-4b35-9871-8c17dd3557f3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.991886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb7997-b6e6-4b35-9871-8c17dd3557f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.992360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb7997-b6e6-4b35-9871-8c17dd3557f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.993591 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb7997-b6e6-4b35-9871-8c17dd3557f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:36.994130 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb7997-b6e6-4b35-9871-8c17dd3557f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.996832 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb7997-b6e6-4b35-9871-8c17dd3557f3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:37.030875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 10/21] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:39.906338 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0132a-b94d-4c6e-9bbd-5ede8396f087 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:39.907386 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0132a-b94d-4c6e-9bbd-5ede8396f087 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:39.908452 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0132a-b94d-4c6e-9bbd-5ede8396f087 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:39.910496 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 12/22] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:39.931069 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a170-c7a0-4615-89e5-b94fd6ec496b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:39.932049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a170-c7a0-4615-89e5-b94fd6ec496b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:39.932543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a170-c7a0-4615-89e5-b94fd6ec496b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:39.962487 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6a42a170-c7a0-4615-89e5-b94fd6ec496b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:39.964079 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6a42a170-c7a0-4615-89e5-b94fd6ec496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:40.067518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 11/23] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:40.471521 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea747-1125-4923-98db-c61d11bd9119 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:40.472227 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea747-1125-4923-98db-c61d11bd9119 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:40.472783 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eea747-1125-4923-98db-c61d11bd9119 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:40.474791 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:40.482399 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875618f-527b-424f-963e-a4d917224c82 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:40.483020 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875618f-527b-424f-963e-a4d917224c82 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:40.483498 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875618f-527b-424f-963e-a4d917224c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:40.514291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-f875618f-527b-424f-963e-a4d917224c82 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:40.515886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-f875618f-527b-424f-963e-a4d917224c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:40.565676 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7abdc5-493a-4a7c-8f4f-d3285c8fd09d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:40.566294 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7abdc5-493a-4a7c-8f4f-d3285c8fd09d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:40.566790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7abdc5-493a-4a7c-8f4f-d3285c8fd09d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:40.568818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 14/25] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:40.574293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48d59-5277-441b-8024-0747195b6f01 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:40.574908 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48d59-5277-441b-8024-0747195b6f01 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:40.575426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48d59-5277-441b-8024-0747195b6f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:40.605246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:40.605760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-71b48d59-5277-441b-8024-0747195b6f01 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:40.607033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-71b48d59-5277-441b-8024-0747195b6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:40.666846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 12/26] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:40.786070 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 15/27] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:51:40.890480 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875618f-527b-424f-963e-a4d917224c82 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:41.059175 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875618f-527b-424f-963e-a4d917224c82 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:41.107121 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1d7fd-2ff7-423b-889c-c32a71d3df46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:41.108239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d7fd-2ff7-423b-889c-c32a71d3df46 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:41.108814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d7fd-2ff7-423b-889c-c32a71d3df46 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:41.109299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d7fd-2ff7-423b-889c-c32a71d3df46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:41.129014 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1d7fd-2ff7-423b-889c-c32a71d3df46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-fcb1d7fd-2ff7-423b-889c-c32a71d3df46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:51:41.135863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:41.136814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:51:41.137593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:51:41.139974 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 13/28] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:51:41.146206 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48d59-5277-441b-8024-0747195b6f01 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:41.250228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:41.282725 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48d59-5277-441b-8024-0747195b6f01 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:41.338389 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:41.339019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:41.339297 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:41.339561 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:41.340238 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:41.340538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:41.342048 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:41.357479 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 16/29] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:51:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:41.367352 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1d7fd-2ff7-423b-889c-c32a71d3df46 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:41.412357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:41.506626 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1d7fd-2ff7-423b-889c-c32a71d3df46 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:41.539941 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:41.595075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71ae18-62ef-4868-99b1-76021d62bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:41.596563 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71ae18-62ef-4868-99b1-76021d62bd03 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:41.597002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71ae18-62ef-4868-99b1-76021d62bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:41.597415 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71ae18-62ef-4868-99b1-76021d62bd03 None admin] PATH_INFO: `/v3/users/4e344534c0524c1e81232c0c48cd6c1f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:41.600064 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71ae18-62ef-4868-99b1-76021d62bd03 None admin] RBAC: Authorizing `identity:get_user(user_id=4e344534c0524c1e81232c0c48cd6c1f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:41.601771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71ae18-62ef-4868-99b1-76021d62bd03 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:41.604579 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 14/30] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:51:41 2022] GET /identity/v3/users/4e344534c0524c1e81232c0c48cd6c1f => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:41.614317 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71ae18-62ef-4868-99b1-76021d62bd03 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:41.772560 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c288-0749-48c1-a992-f47cb8a9e425 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:41.855132 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9d88b-e892-4bdb-b867-3df274fc2077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:41.857628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d88b-e892-4bdb-b867-3df274fc2077 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:41.858448 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d88b-e892-4bdb-b867-3df274fc2077 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:41.859115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d88b-e892-4bdb-b867-3df274fc2077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:41.864953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:41.891520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9d88b-e892-4bdb-b867-3df274fc2077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:41.895687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9d88b-e892-4bdb-b867-3df274fc2077 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-51f9d88b-e892-4bdb-b867-3df274fc2077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:51:41.929073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:41.930753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:51:41.932375 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:51:41.932375 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:51:41.932375 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:51:41.932717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71ae18-62ef-4868-99b1-76021d62bd03 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:41.935709 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:41.943019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 17/31] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:51:41.947552 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b7fe-3657-40d1-967a-a2c458306b01 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:41.948454 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b7fe-3657-40d1-967a-a2c458306b01 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:41.949315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b7fe-3657-40d1-967a-a2c458306b01 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:41.957250 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 18/32] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:41.959309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36b7fe-3657-40d1-967a-a2c458306b01 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:41.998444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a10b-33e7-41e8-aecd-7caf4215d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:41.999724 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a10b-33e7-41e8-aecd-7caf4215d83e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:42.000348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a10b-33e7-41e8-aecd-7caf4215d83e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:42.001056 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a10b-33e7-41e8-aecd-7caf4215d83e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:42.003316 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292a10b-33e7-41e8-aecd-7caf4215d83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:42.006135 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292a10b-33e7-41e8-aecd-7caf4215d83e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:42.009112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 15/33] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:42.010697 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a10b-33e7-41e8-aecd-7caf4215d83e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:42.090507 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36b7fe-3657-40d1-967a-a2c458306b01 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:42.132574 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52d5cb-5ade-46bf-9638-bb93b394a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:42.133207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52d5cb-5ade-46bf-9638-bb93b394a508 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:42.133492 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52d5cb-5ade-46bf-9638-bb93b394a508 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:42.133769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52d5cb-5ade-46bf-9638-bb93b394a508 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:42.134655 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52d5cb-5ade-46bf-9638-bb93b394a508 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:42.135987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52d5cb-5ade-46bf-9638-bb93b394a508 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:42.141193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a10b-33e7-41e8-aecd-7caf4215d83e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:42.184065 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ebd6b-9869-44a6-9b99-89fa608e17ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:42.185261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebd6b-9869-44a6-9b99-89fa608e17ff None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:42.185761 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebd6b-9869-44a6-9b99-89fa608e17ff None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:42.186379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ebd6b-9869-44a6-9b99-89fa608e17ff None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:42.187349 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ebd6b-9869-44a6-9b99-89fa608e17ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:42.187899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ebd6b-9869-44a6-9b99-89fa608e17ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:42.190153 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ebd6b-9869-44a6-9b99-89fa608e17ff None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:42.203921 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 16/34] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:42.206180 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bbf2a-dabb-40aa-b230-e283ed65c457 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:42.206715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bbf2a-dabb-40aa-b230-e283ed65c457 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:42.207227 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bbf2a-dabb-40aa-b230-e283ed65c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:42.227604 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-481bbf2a-dabb-40aa-b230-e283ed65c457 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:42.229200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-481bbf2a-dabb-40aa-b230-e283ed65c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:42.260988 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:42.283450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 19/35] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 24 09:51:41 2022] POST /identity/v3/roles => generated 219 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:42.284537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52d5cb-5ade-46bf-9638-bb93b394a508 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:42.340529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 17/36] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:42.341952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bbf2a-dabb-40aa-b230-e283ed65c457 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:42.402185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:42.530191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52d5cb-5ade-46bf-9638-bb93b394a508 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:42.564767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bbf2a-dabb-40aa-b230-e283ed65c457 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:42.578189 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1afb2-261e-4ca3-8443-f8f9cd0238b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:42.579030 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1afb2-261e-4ca3-8443-f8f9cd0238b2 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:42.579333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1afb2-261e-4ca3-8443-f8f9cd0238b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:42.579596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1afb2-261e-4ca3-8443-f8f9cd0238b2 None admin] PATH_INFO: `/v3/domains/default/users/4e344534c0524c1e81232c0c48cd6c1f/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:42.583200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1afb2-261e-4ca3-8443-f8f9cd0238b2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4e344534c0524c1e81232c0c48cd6c1f, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:42.584851 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1afb2-261e-4ca3-8443-f8f9cd0238b2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:42.615323 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 20/37] 10.222.0.70 () {58 vars in 1361 bytes} [Wed Aug 24 09:51:42 2022] PUT /identity/v3/domains/default/users/4e344534c0524c1e81232c0c48cd6c1f/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:42.617404 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15d067-2cdd-4cd0-928a-f55e5cdc7da1 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:42.617872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15d067-2cdd-4cd0-928a-f55e5cdc7da1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:42.618321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15d067-2cdd-4cd0-928a-f55e5cdc7da1 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:42.620772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 21/38] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:42.627742 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e634-5c6e-4549-8a11-67503176b4f2 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:42.628107 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e634-5c6e-4549-8a11-67503176b4f2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:42.628471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e634-5c6e-4549-8a11-67503176b4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:42.631281 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b0939-8d22-411e-995e-173ffac70567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:42.632288 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0939-8d22-411e-995e-173ffac70567 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:42.632835 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0939-8d22-411e-995e-173ffac70567 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:42.633383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0939-8d22-411e-995e-173ffac70567 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:42.634303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b0939-8d22-411e-995e-173ffac70567 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:42.635977 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b0939-8d22-411e-995e-173ffac70567 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:42.654968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fc01e634-5c6e-4549-8a11-67503176b4f2 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:42.656515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fc01e634-5c6e-4549-8a11-67503176b4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:42.752613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 22/39] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:42.826977 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 18/40] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:51:42 2022] POST /identity/v3/projects => generated 301 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:42.937832 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e634-5c6e-4549-8a11-67503176b4f2 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:42.992563 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:43.063602 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254f68c-4aab-4d26-954e-594d46229a12 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.063949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254f68c-4aab-4d26-954e-594d46229a12 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.064218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254f68c-4aab-4d26-954e-594d46229a12 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:43.066347 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 19/41] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:43.076383 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e634-5c6e-4549-8a11-67503176b4f2 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:43.079742 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66195ad0-128b-4b0f-a689-60a82d42d55a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.080082 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66195ad0-128b-4b0f-a689-60a82d42d55a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.080308 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66195ad0-128b-4b0f-a689-60a82d42d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:43.114177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-66195ad0-128b-4b0f-a689-60a82d42d55a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:43.115846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-66195ad0-128b-4b0f-a689-60a82d42d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:43.143403 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5adb41-da06-45d6-9fde-f3b0ab478bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:43.144884 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5adb41-da06-45d6-9fde-f3b0ab478bf1 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.145457 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5adb41-da06-45d6-9fde-f3b0ab478bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.145911 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5adb41-da06-45d6-9fde-f3b0ab478bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:43.146971 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5adb41-da06-45d6-9fde-f3b0ab478bf1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:43.148605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:43.149960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5adb41-da06-45d6-9fde-f3b0ab478bf1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:43.171510 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 23/42] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 24 09:51:42 2022] POST /identity/v3/roles => generated 223 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:43.172722 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5adb41-da06-45d6-9fde-f3b0ab478bf1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:43.214265 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 20/43] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:43.311902 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:43.317370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5adb41-da06-45d6-9fde-f3b0ab478bf1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:43.369848 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209ed42-1e6d-461a-afea-da1461340047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:43.370801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ed42-1e6d-461a-afea-da1461340047 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.371306 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ed42-1e6d-461a-afea-da1461340047 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.371743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ed42-1e6d-461a-afea-da1461340047 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:43.372916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209ed42-1e6d-461a-afea-da1461340047 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:43.375372 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209ed42-1e6d-461a-afea-da1461340047 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:43.402666 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 24/44] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 24 09:51:43 2022] POST /identity/v3/roles => generated 225 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:43.590150 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66195ad0-128b-4b0f-a689-60a82d42d55a None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:43.758692 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66195ad0-128b-4b0f-a689-60a82d42d55a None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:43.798169 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61695971-bfc5-4f5c-9a46-831e34321fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:43.799365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61695971-bfc5-4f5c-9a46-831e34321fac None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.799641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61695971-bfc5-4f5c-9a46-831e34321fac None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.799911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61695971-bfc5-4f5c-9a46-831e34321fac None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:43.801254 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61695971-bfc5-4f5c-9a46-831e34321fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:43.802857 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61695971-bfc5-4f5c-9a46-831e34321fac None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:43.804482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 21/45] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:43.810769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209ed42-1e6d-461a-afea-da1461340047 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:43.940154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209ed42-1e6d-461a-afea-da1461340047 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:43.978634 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca817c2-6504-48ce-8749-ad8bbe5a96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:43.979269 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca817c2-6504-48ce-8749-ad8bbe5a96a0 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.979552 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca817c2-6504-48ce-8749-ad8bbe5a96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.979828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca817c2-6504-48ce-8749-ad8bbe5a96a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:43.980486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca817c2-6504-48ce-8749-ad8bbe5a96a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:43.982026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca817c2-6504-48ce-8749-ad8bbe5a96a0 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.013644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 25/46] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:51:43 2022] POST /identity/v3/projects => generated 312 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:45.200953 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e650d-5958-4a33-9eff-3ea3f2ac0173 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:45.201481 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e650d-5958-4a33-9eff-3ea3f2ac0173 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:45.201701 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e650d-5958-4a33-9eff-3ea3f2ac0173 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:45.203981 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 22/47] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:45.212136 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af4be-6110-4a90-8802-bcaa41d05bfe None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:45.212972 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af4be-6110-4a90-8802-bcaa41d05bfe None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:45.213118 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96af4be-6110-4a90-8802-bcaa41d05bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:45.234507 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-d96af4be-6110-4a90-8802-bcaa41d05bfe None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:45.235910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-d96af4be-6110-4a90-8802-bcaa41d05bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:45.240110 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:45.319395 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 26/48] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:45.643804 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e650d-5958-4a33-9eff-3ea3f2ac0173 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:45.661165 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:45.782680 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e650d-5958-4a33-9eff-3ea3f2ac0173 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:45.840317 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6c142-18da-43d0-8d81-d0248c024563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:45.841336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c142-18da-43d0-8d81-d0248c024563 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:45.841790 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c142-18da-43d0-8d81-d0248c024563 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:45.842254 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c142-18da-43d0-8d81-d0248c024563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:45.860878 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6c142-18da-43d0-8d81-d0248c024563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-e0c6c142-18da-43d0-8d81-d0248c024563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:51:45.870367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:45.871502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:51:45.872296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:51:45.873460 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 23/49] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:51:45.879596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af4be-6110-4a90-8802-bcaa41d05bfe None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:45.994862 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96af4be-6110-4a90-8802-bcaa41d05bfe None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:46.033696 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:46.034451 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:46.034840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:46.035221 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:46.036018 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:46.036426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:46.037996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:46.047949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 27/50] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:46.054681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6c142-18da-43d0-8d81-d0248c024563 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:46.186811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:46.227723 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6c142-18da-43d0-8d81-d0248c024563 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:46.269826 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6942be-e853-45a9-af65-729bcb161633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:46.270471 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6942be-e853-45a9-af65-729bcb161633 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:46.270758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6942be-e853-45a9-af65-729bcb161633 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:46.271036 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6942be-e853-45a9-af65-729bcb161633 None admin] PATH_INFO: `/v3/users/4e344534c0524c1e81232c0c48cd6c1f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:46.272229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6942be-e853-45a9-af65-729bcb161633 None admin] RBAC: Authorizing `identity:get_user(user_id=4e344534c0524c1e81232c0c48cd6c1f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:46.273725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6942be-e853-45a9-af65-729bcb161633 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:46.275340 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 24/51] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:51:46 2022] GET /identity/v3/users/4e344534c0524c1e81232c0c48cd6c1f => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:46.281608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:46.286298 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:46.394350 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f37f6-0dbd-44f5-b40e-7707b1e087ae None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:46.394751 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f37f6-0dbd-44f5-b40e-7707b1e087ae None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:46.395043 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f37f6-0dbd-44f5-b40e-7707b1e087ae None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:46.396711 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 25/52] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:51:46.403114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c590a-a6c8-4ba3-8301-4c1b500ec0ab None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:46.403449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c590a-a6c8-4ba3-8301-4c1b500ec0ab None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:46.403768 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c590a-a6c8-4ba3-8301-4c1b500ec0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:46.425343 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-375c590a-a6c8-4ba3-8301-4c1b500ec0ab None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:46.426767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-375c590a-a6c8-4ba3-8301-4c1b500ec0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:46.448169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6defea2-9df1-4772-a825-e5a3faed09fb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:46.499101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33650-1fb5-456c-aca6-e9704da8a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:46.499743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33650-1fb5-456c-aca6-e9704da8a5af None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:46.500180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33650-1fb5-456c-aca6-e9704da8a5af None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:46.500456 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f33650-1fb5-456c-aca6-e9704da8a5af None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:46.502254 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f33650-1fb5-456c-aca6-e9704da8a5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:46.503736 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f33650-1fb5-456c-aca6-e9704da8a5af None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:46.504509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 26/53] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:51:46.505623 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 28/54] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:46.514113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c590a-a6c8-4ba3-8301-4c1b500ec0ab None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:46.597494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:46.636534 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c590a-a6c8-4ba3-8301-4c1b500ec0ab None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:46.679198 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:46.679912 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:46.680266 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:46.680639 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:46.681514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.domain.id=default, user.id=4e344534c0524c1e81232c0c48cd6c1f) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:46.681900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:46.683704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:46.694387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1322 bytes} [Wed Aug 24 09:51:46 2022] GET /identity/v3/role_assignments?user.id=4e344534c0524c1e81232c0c48cd6c1f&scope.domain.id=default&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 530 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:51:46.846197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33650-1fb5-456c-aca6-e9704da8a5af None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:46.949537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:46.994685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f33650-1fb5-456c-aca6-e9704da8a5af None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:47.030022 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3c2c-e5c9-4ded-bd4d-5216f183e361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:47.030667 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3c2c-e5c9-4ded-bd4d-5216f183e361 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:47.030955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3c2c-e5c9-4ded-bd4d-5216f183e361 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:47.031235 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3c2c-e5c9-4ded-bd4d-5216f183e361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:47.032391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3c2c-e5c9-4ded-bd4d-5216f183e361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:47.034465 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3c2c-e5c9-4ded-bd4d-5216f183e361 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:47.036075 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 29/56] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:47.041971 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:47.161209 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1236ac8-21a6-45ca-bc27-8b0d16c4dbfd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:47.196431 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8a596-cabe-4593-9d09-be361cf315d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:47.197080 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8a596-cabe-4593-9d09-be361cf315d3 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:47.197358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8a596-cabe-4593-9d09-be361cf315d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:47.197628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8a596-cabe-4593-9d09-be361cf315d3 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:47.198274 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8a596-cabe-4593-9d09-be361cf315d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:47.199731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8a596-cabe-4593-9d09-be361cf315d3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:47.205119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:47.231247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 28/57] 10.222.0.70 () {60 vars in 1140 bytes} [Wed Aug 24 09:51:47 2022] POST /identity/v3/projects => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:51:49.497215 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb514941-af87-43d3-ae9c-5b9d6b5a5593 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:49.497837 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb514941-af87-43d3-ae9c-5b9d6b5a5593 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:49.497837 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb514941-af87-43d3-ae9c-5b9d6b5a5593 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:49.499154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 30/58] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:49.505517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ae161-016b-4aa6-a1e4-1f1b8f4920ed None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:49.506327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ae161-016b-4aa6-a1e4-1f1b8f4920ed None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:49.506327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ae161-016b-4aa6-a1e4-1f1b8f4920ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:49.527509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-405ae161-016b-4aa6-a1e4-1f1b8f4920ed None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:49.528828 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-405ae161-016b-4aa6-a1e4-1f1b8f4920ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:49.607972 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 29/59] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:49.947504 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb514941-af87-43d3-ae9c-5b9d6b5a5593 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:50.119304 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb514941-af87-43d3-ae9c-5b9d6b5a5593 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:50.194029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65c230-82f5-485b-895b-66fc44be3b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:50.195020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c230-82f5-485b-895b-66fc44be3b95 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:50.195476 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c230-82f5-485b-895b-66fc44be3b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:50.195833 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65c230-82f5-485b-895b-66fc44be3b95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:50.197092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65c230-82f5-485b-895b-66fc44be3b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:50.198546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65c230-82f5-485b-895b-66fc44be3b95 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:50.200184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 31/60] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:50.209077 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ae161-016b-4aa6-a1e4-1f1b8f4920ed None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:50.317503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ae161-016b-4aa6-a1e4-1f1b8f4920ed None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:50.334936 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:50.355997 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83522f5a-8ad2-4fe3-a231-233a5be14a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:50.356608 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83522f5a-8ad2-4fe3-a231-233a5be14a5e None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:50.356919 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83522f5a-8ad2-4fe3-a231-233a5be14a5e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:50.357189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83522f5a-8ad2-4fe3-a231-233a5be14a5e None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:50.357829 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83522f5a-8ad2-4fe3-a231-233a5be14a5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:50.359277 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83522f5a-8ad2-4fe3-a231-233a5be14a5e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:50.392545 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 30/61] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:51:50 2022] POST /identity/v3/users => generated 275 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:54.368999 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398747-e425-4f1c-82b6-ff8c95a19161 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:54.369764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398747-e425-4f1c-82b6-ff8c95a19161 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:54.369764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398747-e425-4f1c-82b6-ff8c95a19161 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:54.370976 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 32/62] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:51:54.380191 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3eae-94e8-4ea1-bf25-0071dd96078d None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:54.380983 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3eae-94e8-4ea1-bf25-0071dd96078d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:54.380983 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3eae-94e8-4ea1-bf25-0071dd96078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:54.405588 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3a6f3eae-94e8-4ea1-bf25-0071dd96078d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:54.406812 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3a6f3eae-94e8-4ea1-bf25-0071dd96078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:54.486771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 31/63] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:54.849536 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c022-bed7-4c5f-b049-61f8ec92eb44 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:54.850013 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c022-bed7-4c5f-b049-61f8ec92eb44 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:54.850260 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c022-bed7-4c5f-b049-61f8ec92eb44 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:54.851517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 33/64] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:51:54.873218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802af1-fc25-4eb3-a5c2-1dce7e1c4a6e None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:54.873674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802af1-fc25-4eb3-a5c2-1dce7e1c4a6e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:54.875175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99f89b-a10c-4753-9668-814527e758e5 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:54.875449 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99f89b-a10c-4753-9668-814527e758e5 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:54.875739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99f89b-a10c-4753-9668-814527e758e5 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:54.876817 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802af1-fc25-4eb3-a5c2-1dce7e1c4a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:54.877618 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 34/65] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:51:54.883612 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28a946-3bfb-4aeb-bf01-8ea30e6733aa None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:54.884216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28a946-3bfb-4aeb-bf01-8ea30e6733aa None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:54.884731 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28a946-3bfb-4aeb-bf01-8ea30e6733aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:54.899481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:54.905853 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-7d28a946-3bfb-4aeb-bf01-8ea30e6733aa None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:54.907848 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-7d28a946-3bfb-4aeb-bf01-8ea30e6733aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:54.944543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3f802af1-fc25-4eb3-a5c2-1dce7e1c4a6e None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:54.944543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3f802af1-fc25-4eb3-a5c2-1dce7e1c4a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:55.053019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 35/66] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:51:55.055657 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d4dc-0e2e-4797-9768-d95a4f854178 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:55.056337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d4dc-0e2e-4797-9768-d95a4f854178 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:55.057014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d4dc-0e2e-4797-9768-d95a4f854178 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:55.057685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 32/67] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:55.059339 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 36/68] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:55.066662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d749-d197-499a-9631-9ceca6c05eb4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:55.067108 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d749-d197-499a-9631-9ceca6c05eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:55.067518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30d749-d197-499a-9631-9ceca6c05eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:55.099486 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8a30d749-d197-499a-9631-9ceca6c05eb4 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:55.101670 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8a30d749-d197-499a-9631-9ceca6c05eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:55.104106 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d4dc-0e2e-4797-9768-d95a4f854178 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:55.162939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:55.310392 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 33/69] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:51:55.433530 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d4dc-0e2e-4797-9768-d95a4f854178 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:55.445828 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30d749-d197-499a-9631-9ceca6c05eb4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:55.507333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d4fd-6bf8-49eb-bafe-687f02079823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:55.508307 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d4fd-6bf8-49eb-bafe-687f02079823 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:55.508877 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d4fd-6bf8-49eb-bafe-687f02079823 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:55.509343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d4fd-6bf8-49eb-bafe-687f02079823 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:55.516373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:55.540951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d4fd-6bf8-49eb-bafe-687f02079823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-0813d4fd-6bf8-49eb-bafe-687f02079823 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:51:55.551405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:55.553163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:51:55.556952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 37/70] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:51:55.567761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d4fd-6bf8-49eb-bafe-687f02079823 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:55.623192 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30d749-d197-499a-9631-9ceca6c05eb4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:55.694541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1316d-b147-47a3-8660-866a9998fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:55.696480 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1316d-b147-47a3-8660-866a9998fc27 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:55.697009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1316d-b147-47a3-8660-866a9998fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:55.697610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1316d-b147-47a3-8660-866a9998fc27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:55.723941 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1316d-b147-47a3-8660-866a9998fc27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-74c1316d-b147-47a3-8660-866a9998fc27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:51:55.732396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:55.734333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:51:55.736477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 34/71] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:51:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:51:55.739637 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20245-2a29-4c7c-92ae-e4c2e139b84e None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:55.739637 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20245-2a29-4c7c-92ae-e4c2e139b84e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:55.739637 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20245-2a29-4c7c-92ae-e4c2e139b84e None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:55.744348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 35/72] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:51:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:51:55.746104 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20245-2a29-4c7c-92ae-e4c2e139b84e None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:55.760631 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d4fd-6bf8-49eb-bafe-687f02079823 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:55.789366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:55.804428 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:55.805078 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:55.805354 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:55.805636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:55.806309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:55.806605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:55.808046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:55.817467 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 38/73] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:51:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:55.817467 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:55.891629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:55.918985 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20245-2a29-4c7c-92ae-e4c2e139b84e None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:55.961715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f043cf-e939-4071-a9a4-ffa0acac4f80 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:55.969039 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22674-ff6e-4fa1-b0b2-d824817599de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:55.970072 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22674-ff6e-4fa1-b0b2-d824817599de None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:55.970538 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22674-ff6e-4fa1-b0b2-d824817599de None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:55.970990 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22674-ff6e-4fa1-b0b2-d824817599de None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:55.972084 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22674-ff6e-4fa1-b0b2-d824817599de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:55.972585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22674-ff6e-4fa1-b0b2-d824817599de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:55.975708 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22674-ff6e-4fa1-b0b2-d824817599de None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:56.003715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 36/74] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:51:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:56.003715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474cea-78e4-41ad-a267-96eb54024ba0 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.003715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474cea-78e4-41ad-a267-96eb54024ba0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.003715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474cea-78e4-41ad-a267-96eb54024ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.018970 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb11aba-463f-4d84-a1ff-7f7e941f2a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:56.019773 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb11aba-463f-4d84-a1ff-7f7e941f2a74 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.020150 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb11aba-463f-4d84-a1ff-7f7e941f2a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.020538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb11aba-463f-4d84-a1ff-7f7e941f2a74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.021817 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9f474cea-78e4-41ad-a267-96eb54024ba0 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:56.023281 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9f474cea-78e4-41ad-a267-96eb54024ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:56.034949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb11aba-463f-4d84-a1ff-7f7e941f2a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-ccb11aba-463f-4d84-a1ff-7f7e941f2a74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:51:56.040926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:56.042506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:51:56.043301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 39/75] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:51:56.045875 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb11aba-463f-4d84-a1ff-7f7e941f2a74 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:56.121863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 37/76] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:51:56.123316 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474cea-78e4-41ad-a267-96eb54024ba0 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:56.160015 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:56.198003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb11aba-463f-4d84-a1ff-7f7e941f2a74 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:56.234540 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:56.268572 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898f592-2225-4097-a281-0a084b016c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:56.269731 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898f592-2225-4097-a281-0a084b016c64 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.270238 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898f592-2225-4097-a281-0a084b016c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.270730 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898f592-2225-4097-a281-0a084b016c64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.289300 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474cea-78e4-41ad-a267-96eb54024ba0 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:56.291617 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898f592-2225-4097-a281-0a084b016c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-0898f592-2225-4097-a281-0a084b016c64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:51:56.304769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:51:56.307537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 40/77] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:51:56.309179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898f592-2225-4097-a281-0a084b016c64 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:56.342517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9fbd1-5898-4173-896d-e0459b0d0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:56.343597 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fbd1-5898-4173-896d-e0459b0d0dba None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.344000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fbd1-5898-4173-896d-e0459b0d0dba None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.344473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fbd1-5898-4173-896d-e0459b0d0dba None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.364909 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9fbd1-5898-4173-896d-e0459b0d0dba None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:56.367085 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9fbd1-5898-4173-896d-e0459b0d0dba None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:56.376118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 38/78] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:51:56 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:56.376118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9fbd1-5898-4173-896d-e0459b0d0dba None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:56.469196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:56.495981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898f592-2225-4097-a281-0a084b016c64 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:56.528203 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9fbd1-5898-4173-896d-e0459b0d0dba None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:56.538150 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfda2a-5202-419c-abce-8a55dd46ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:56.538805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfda2a-5202-419c-abce-8a55dd46ca40 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.539092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfda2a-5202-419c-abce-8a55dd46ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.539367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfda2a-5202-419c-abce-8a55dd46ca40 None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.540749 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfda2a-5202-419c-abce-8a55dd46ca40 None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:56.542505 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfda2a-5202-419c-abce-8a55dd46ca40 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:56.544203 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 41/79] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:51:56 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:56.545027 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfda2a-5202-419c-abce-8a55dd46ca40 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:56.584156 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:56.584959 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.585334 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.585700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.586472 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:56.586867 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:56.588472 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:56.600549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 39/80] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:51:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:56.601196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:56.612707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:56.689050 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfda2a-5202-419c-abce-8a55dd46ca40 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:56.729998 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd940-1638-4899-8dd7-ebc8414c67b8 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:56.737701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:56.738406 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.738829 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.739220 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.740090 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:56.740511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:56.742155 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:56.757299 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 42/81] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:51:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:56.757299 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:56.783505 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0325a-73aa-4200-a020-d630fb343f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:56.784339 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0325a-73aa-4200-a020-d630fb343f1a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.784790 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0325a-73aa-4200-a020-d630fb343f1a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.785266 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0325a-73aa-4200-a020-d630fb343f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.789055 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:56.881018 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2ee60-e2a6-4cfe-85c4-62938e378d07 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:56.881796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0325a-73aa-4200-a020-d630fb343f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:56.883489 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0325a-73aa-4200-a020-d630fb343f1a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:56.892198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:56.928240 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4e330-630d-4138-ba52-fcd6b88e7dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:56.929124 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e330-630d-4138-ba52-fcd6b88e7dfc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:56.929493 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e330-630d-4138-ba52-fcd6b88e7dfc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:56.929948 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e330-630d-4138-ba52-fcd6b88e7dfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:56.931510 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4e330-630d-4138-ba52-fcd6b88e7dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:56.933105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4e330-630d-4138-ba52-fcd6b88e7dfc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:56.934777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 43/82] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:51:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:56.935706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4e330-630d-4138-ba52-fcd6b88e7dfc None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:57.038128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 40/83] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:57.038128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0325a-73aa-4200-a020-d630fb343f1a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:57.058466 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4e330-630d-4138-ba52-fcd6b88e7dfc None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:57.075058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:57.107858 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc290a22-4faa-4504-9fae-f6cbffa7cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:57.108639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc290a22-4faa-4504-9fae-f6cbffa7cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:57.109019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc290a22-4faa-4504-9fae-f6cbffa7cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:57.109295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc290a22-4faa-4504-9fae-f6cbffa7cbc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:57.166830 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0325a-73aa-4200-a020-d630fb343f1a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:57.177694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:57.209342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc290a22-4faa-4504-9fae-f6cbffa7cbc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:57.210842 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc290a22-4faa-4504-9fae-f6cbffa7cbc4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:57.222065 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cb45-d22d-4a36-a036-c46ce32cc72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:57.222873 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cb45-d22d-4a36-a036-c46ce32cc72f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:57.223274 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cb45-d22d-4a36-a036-c46ce32cc72f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:57.223732 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cb45-d22d-4a36-a036-c46ce32cc72f None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:57.225196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cb45-d22d-4a36-a036-c46ce32cc72f None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:57.227152 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cb45-d22d-4a36-a036-c46ce32cc72f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:57.229209 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 41/84] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:51:57 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:57.234721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cb45-d22d-4a36-a036-c46ce32cc72f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:57.330534 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 44/85] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:57.332190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc290a22-4faa-4504-9fae-f6cbffa7cbc4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:57.386560 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cb45-d22d-4a36-a036-c46ce32cc72f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:57.390009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:57.443933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62a9d-10aa-40c9-9ab5-b1cc9894d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:57.444686 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62a9d-10aa-40c9-9ab5-b1cc9894d247 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:57.445151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62a9d-10aa-40c9-9ab5-b1cc9894d247 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:57.445608 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f62a9d-10aa-40c9-9ab5-b1cc9894d247 None admin] PATH_INFO: `/v3/users/4e344534c0524c1e81232c0c48cd6c1f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:57.447667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f62a9d-10aa-40c9-9ab5-b1cc9894d247 None admin] RBAC: Authorizing `identity:get_user(user_id=4e344534c0524c1e81232c0c48cd6c1f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:57.450314 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f62a9d-10aa-40c9-9ab5-b1cc9894d247 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:57.453074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 42/86] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:51:57 2022] GET /identity/v3/users/4e344534c0524c1e81232c0c48cd6c1f => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:57.461618 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62a9d-10aa-40c9-9ab5-b1cc9894d247 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:57.461789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:57.488599 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc290a22-4faa-4504-9fae-f6cbffa7cbc4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:57.531954 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2803ee-9abf-41f4-8b06-dd2745b36c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:57.533570 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2803ee-9abf-41f4-8b06-dd2745b36c19 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:57.534037 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2803ee-9abf-41f4-8b06-dd2745b36c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:57.534493 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2803ee-9abf-41f4-8b06-dd2745b36c19 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:57.535585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2803ee-9abf-41f4-8b06-dd2745b36c19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:57.538228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2803ee-9abf-41f4-8b06-dd2745b36c19 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:57.577416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 45/87] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:51:57 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:57.578560 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2803ee-9abf-41f4-8b06-dd2745b36c19 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:57.588301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f62a9d-10aa-40c9-9ab5-b1cc9894d247 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:57.658324 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec383bd-ae0b-423f-998a-d50e7baf5acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:57.659347 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec383bd-ae0b-423f-998a-d50e7baf5acf None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:57.659827 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec383bd-ae0b-423f-998a-d50e7baf5acf None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:57.660300 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec383bd-ae0b-423f-998a-d50e7baf5acf None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:57.662364 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec383bd-ae0b-423f-998a-d50e7baf5acf None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:57.664693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec383bd-ae0b-423f-998a-d50e7baf5acf None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:57.667396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 43/88] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:51:57 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:57.668793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec383bd-ae0b-423f-998a-d50e7baf5acf None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:57.743373 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:57.779342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2803ee-9abf-41f4-8b06-dd2745b36c19 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:57.835715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:57.844923 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da105c1c-2bb5-4923-b8a2-eae47d13d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:57.844923 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105c1c-2bb5-4923-b8a2-eae47d13d7eb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:57.845397 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105c1c-2bb5-4923-b8a2-eae47d13d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:57.845847 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105c1c-2bb5-4923-b8a2-eae47d13d7eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:57.862061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec383bd-ae0b-423f-998a-d50e7baf5acf None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:57.939589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca561ba5-5fa6-4d9a-9cb4-8a1689b05bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:57.940738 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca561ba5-5fa6-4d9a-9cb4-8a1689b05bb4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:57.941265 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca561ba5-5fa6-4d9a-9cb4-8a1689b05bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:57.941750 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca561ba5-5fa6-4d9a-9cb4-8a1689b05bb4 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:57.944780 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca561ba5-5fa6-4d9a-9cb4-8a1689b05bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:57.947778 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca561ba5-5fa6-4d9a-9cb4-8a1689b05bb4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:57.951287 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 44/89] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:51:57 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:57.952558 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca561ba5-5fa6-4d9a-9cb4-8a1689b05bb4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:57.975494 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da105c1c-2bb5-4923-b8a2-eae47d13d7eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:57.977161 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da105c1c-2bb5-4923-b8a2-eae47d13d7eb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:58.105731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca561ba5-5fa6-4d9a-9cb4-8a1689b05bb4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:58.114500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:58.147537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511459ce-01c7-48dd-99a9-b475820b3d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:58.148168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511459ce-01c7-48dd-99a9-b475820b3d56 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:58.148446 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511459ce-01c7-48dd-99a9-b475820b3d56 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:58.148869 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511459ce-01c7-48dd-99a9-b475820b3d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:58.166088 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 46/90] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:58.167699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da105c1c-2bb5-4923-b8a2-eae47d13d7eb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:58.223788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:58.281148 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511459ce-01c7-48dd-99a9-b475820b3d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:58.282726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511459ce-01c7-48dd-99a9-b475820b3d56 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:58.323184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da105c1c-2bb5-4923-b8a2-eae47d13d7eb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:58.378678 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:58.380329 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:58.381266 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:58.382030 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:58.383806 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] RBAC: Adding query filter params (role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08, user.id=f4818dd43b034eaeb350bdeba58b6cea) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:58.384804 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:58.387983 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:58.400147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 47/91] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:51:58 2022] GET /identity/v3/role_assignments?user.id=f4818dd43b034eaeb350bdeba58b6cea&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:58.410968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:58.452715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 45/92] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:58.452715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511459ce-01c7-48dd-99a9-b475820b3d56 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:58.456649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:58.574275 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511459ce-01c7-48dd-99a9-b475820b3d56 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:58.620214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856353-7418-4e22-aa9d-0081a9f84c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:58.621725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856353-7418-4e22-aa9d-0081a9f84c1a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:58.622069 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856353-7418-4e22-aa9d-0081a9f84c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:58.622355 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856353-7418-4e22-aa9d-0081a9f84c1a None admin] PATH_INFO: `/v3/projects/83bd00669fdc42abbc5807694c697c49` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:58.623750 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856353-7418-4e22-aa9d-0081a9f84c1a None admin] RBAC: Authorizing `identity:get_project(project_id=83bd00669fdc42abbc5807694c697c49)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:58.627734 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856353-7418-4e22-aa9d-0081a9f84c1a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:58.629895 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 46/93] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:51:58 2022] GET /identity/v3/projects/83bd00669fdc42abbc5807694c697c49 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:58.633556 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856353-7418-4e22-aa9d-0081a9f84c1a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:58.747966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:58.768380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d3d4a-d607-49a9-8450-b35ea01e1b3d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:58.873264 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:58.898161 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:58.899206 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:58.899716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:58.900208 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:58.901642 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] RBAC: Adding query filter params (role.id=c4c1742a54eb440c9d94f137cb668187, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08, user.id=f4818dd43b034eaeb350bdeba58b6cea) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:58.902197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:58.908251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:58.932349 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 48/94] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:51:58 2022] GET /identity/v3/role_assignments?user.id=f4818dd43b034eaeb350bdeba58b6cea&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=c4c1742a54eb440c9d94f137cb668187 => generated 259 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:58.936494 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:58.963378 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856353-7418-4e22-aa9d-0081a9f84c1a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.097250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41860519-9273-4c4e-a08a-a6e81d8feac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.098367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41860519-9273-4c4e-a08a-a6e81d8feac1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.098870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41860519-9273-4c4e-a08a-a6e81d8feac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.099357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41860519-9273-4c4e-a08a-a6e81d8feac1 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.104386 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41860519-9273-4c4e-a08a-a6e81d8feac1 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.108565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41860519-9273-4c4e-a08a-a6e81d8feac1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.118598 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 47/95] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:51:58 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:59.124880 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41860519-9273-4c4e-a08a-a6e81d8feac1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.237544 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efd11d-a6d2-4156-80c7-625832b22cf9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.275699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1a433-7470-436f-be1e-7f39054e7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.276331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1a433-7470-436f-be1e-7f39054e7e82 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.276616 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1a433-7470-436f-be1e-7f39054e7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.276948 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1a433-7470-436f-be1e-7f39054e7e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.277672 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1a433-7470-436f-be1e-7f39054e7e82 None admin] RBAC: Adding query filter params (role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=83bd00669fdc42abbc5807694c697c49, user.id=f4818dd43b034eaeb350bdeba58b6cea) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:59.278011 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1a433-7470-436f-be1e-7f39054e7e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.279462 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1a433-7470-436f-be1e-7f39054e7e82 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.286461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 49/96] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:51:58 2022] GET /identity/v3/role_assignments?user.id=f4818dd43b034eaeb350bdeba58b6cea&scope.project.id=83bd00669fdc42abbc5807694c697c49&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:59.370953 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41860519-9273-4c4e-a08a-a6e81d8feac1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.446543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec282040-ad86-42ac-92da-85430a54b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.448197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282040-ad86-42ac-92da-85430a54b49f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.449041 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282040-ad86-42ac-92da-85430a54b49f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.449864 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282040-ad86-42ac-92da-85430a54b49f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.451762 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec282040-ad86-42ac-92da-85430a54b49f None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08, user.id=4e344534c0524c1e81232c0c48cd6c1f) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:59.452684 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec282040-ad86-42ac-92da-85430a54b49f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.456501 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec282040-ad86-42ac-92da-85430a54b49f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.473117 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 48/97] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:51:59 2022] GET /identity/v3/role_assignments?user.id=4e344534c0524c1e81232c0c48cd6c1f&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 259 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:01.192534 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d7c2-d9a1-4bb9-a312-92b54179c0f4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:01.194174 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d7c2-d9a1-4bb9-a312-92b54179c0f4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:01.194980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d7c2-d9a1-4bb9-a312-92b54179c0f4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:01.197925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 50/98] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:01.204759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bc9c4-7753-4e85-91a6-e498ee2e8d46 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:01.206232 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bc9c4-7753-4e85-91a6-e498ee2e8d46 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:01.207022 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bc9c4-7753-4e85-91a6-e498ee2e8d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:01.237340 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:01.248688 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-912bc9c4-7753-4e85-91a6-e498ee2e8d46 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:01.253729 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-912bc9c4-7753-4e85-91a6-e498ee2e8d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:01.391361 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 49/99] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:01.868941 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff61e-e9bd-4cc8-8fc5-95483cfdd330 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:01.869429 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff61e-e9bd-4cc8-8fc5-95483cfdd330 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:01.869908 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ff61e-e9bd-4cc8-8fc5-95483cfdd330 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:01.872776 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 51/100] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:01.881593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7673-f7d7-439f-abef-9fe249b5ffef None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:01.881948 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7673-f7d7-439f-abef-9fe249b5ffef None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:01.882356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7673-f7d7-439f-abef-9fe249b5ffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:01.918791 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-39ec7673-f7d7-439f-abef-9fe249b5ffef None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:01.920908 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-39ec7673-f7d7-439f-abef-9fe249b5ffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:02.048473 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ff61e-e9bd-4cc8-8fc5-95483cfdd330 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:02.062646 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 50/101] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:02.113046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:02.232873 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ff61e-e9bd-4cc8-8fc5-95483cfdd330 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:02.286492 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaf39b-a106-4fb4-93a5-17d903fca3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:02.287151 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf39b-a106-4fb4-93a5-17d903fca3c2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:02.287437 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf39b-a106-4fb4-93a5-17d903fca3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:02.287715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf39b-a106-4fb4-93a5-17d903fca3c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:02.305723 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaf39b-a106-4fb4-93a5-17d903fca3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-acaaf39b-a106-4fb4-93a5-17d903fca3c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:02.311097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:02.312020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:02.312882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 52/102] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:02.323112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec7673-f7d7-439f-abef-9fe249b5ffef None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:02.507424 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:02.574782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67565a3-de4d-46d5-a061-54e85e3797a7 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:02.575129 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67565a3-de4d-46d5-a061-54e85e3797a7 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:02.575352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67565a3-de4d-46d5-a061-54e85e3797a7 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:02.576910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 53/103] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:02.589193 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f494d-38ab-46c4-bfcd-668071a1f7b4 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:02.589508 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f494d-38ab-46c4-bfcd-668071a1f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:02.589754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f494d-38ab-46c4-bfcd-668071a1f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:02.593565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec7673-f7d7-439f-abef-9fe249b5ffef None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:02.621401 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-076f494d-38ab-46c4-bfcd-668071a1f7b4 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:02.622634 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-076f494d-38ab-46c4-bfcd-668071a1f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:02.706089 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:02.707177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:02.707851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:02.708366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:02.709643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:02.710161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:02.712930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:02.735219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 51/104] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:02.742419 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:02.820744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 54/105] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:02.955425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e12e7-7685-44c6-8feb-922ee5121239 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:02.993119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:03.004125 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42709081-c773-4f4c-b71e-8abb14978c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:03.005185 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42709081-c773-4f4c-b71e-8abb14978c1a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:03.005721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42709081-c773-4f4c-b71e-8abb14978c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:03.006213 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42709081-c773-4f4c-b71e-8abb14978c1a None admin] PATH_INFO: `/v3/users/16b06cb9bec24e709ca66715aa644dc3` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:03.022696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42709081-c773-4f4c-b71e-8abb14978c1a None admin] RBAC: Authorizing `identity:get_user(user_id=16b06cb9bec24e709ca66715aa644dc3)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:03.024754 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42709081-c773-4f4c-b71e-8abb14978c1a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:03.026728 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 52/106] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:02 2022] GET /identity/v3/users/16b06cb9bec24e709ca66715aa644dc3 => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:03.033715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f494d-38ab-46c4-bfcd-668071a1f7b4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:03.060176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:03.082205 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5cff5-1201-41f7-96a2-9c3ee4a03716 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:03.082795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5cff5-1201-41f7-96a2-9c3ee4a03716 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:03.083268 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5cff5-1201-41f7-96a2-9c3ee4a03716 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:03.085167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 53/107] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:03.103561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c323db-b4a4-4042-9d11-3c9647568085 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:03.104165 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c323db-b4a4-4042-9d11-3c9647568085 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:03.104686 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c323db-b4a4-4042-9d11-3c9647568085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:03.141766 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-a7c323db-b4a4-4042-9d11-3c9647568085 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:03.143412 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a7c323db-b4a4-4042-9d11-3c9647568085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:03.196768 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f494d-38ab-46c4-bfcd-668071a1f7b4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:03.259792 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5bfa-bc82-426d-a9d2-5d17fb24991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:03.260711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5bfa-bc82-426d-a9d2-5d17fb24991f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:03.261210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5bfa-bc82-426d-a9d2-5d17fb24991f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:03.261710 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5bfa-bc82-426d-a9d2-5d17fb24991f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:03.307633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 54/108] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:03.308960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c323db-b4a4-4042-9d11-3c9647568085 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:03.427018 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a5bfa-bc82-426d-a9d2-5d17fb24991f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:03.430840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a5bfa-bc82-426d-a9d2-5d17fb24991f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:03.468344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:03.587568 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c323db-b4a4-4042-9d11-3c9647568085 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:03.644816 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:03.705991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9e121-9c15-4118-8ec1-4fe625b26ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:03.709271 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9e121-9c15-4118-8ec1-4fe625b26ffc None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:03.710152 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9e121-9c15-4118-8ec1-4fe625b26ffc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:03.713914 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9e121-9c15-4118-8ec1-4fe625b26ffc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:03.716337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9e121-9c15-4118-8ec1-4fe625b26ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:03.722516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9e121-9c15-4118-8ec1-4fe625b26ffc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:03.728201 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 55/109] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:52:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:03.741400 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9e121-9c15-4118-8ec1-4fe625b26ffc None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:03.784465 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 55/110] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:03.794407 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5bfa-bc82-426d-a9d2-5d17fb24991f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:04.062861 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9e121-9c15-4118-8ec1-4fe625b26ffc None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:04.080789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5bfa-bc82-426d-a9d2-5d17fb24991f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:04.115729 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160431d8-41c3-4bdc-9107-9ea14374a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:04.116368 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160431d8-41c3-4bdc-9107-9ea14374a247 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.116654 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160431d8-41c3-4bdc-9107-9ea14374a247 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.116964 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160431d8-41c3-4bdc-9107-9ea14374a247 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.117723 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160431d8-41c3-4bdc-9107-9ea14374a247 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:04.118013 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:04.119270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160431d8-41c3-4bdc-9107-9ea14374a247 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:04.146700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb2765-52a5-436b-b2d9-3489d29f5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:04.147365 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2765-52a5-436b-b2d9-3489d29f5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.147684 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2765-52a5-436b-b2d9-3489d29f5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.148061 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2765-52a5-436b-b2d9-3489d29f5cf3 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.149341 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb2765-52a5-436b-b2d9-3489d29f5cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:04.150959 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb2765-52a5-436b-b2d9-3489d29f5cf3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:04.152934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 56/111] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:03 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:04.159030 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb2765-52a5-436b-b2d9-3489d29f5cf3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:04.168176 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 56/112] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:52:03 2022] POST /identity/v3/projects => generated 302 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:52:04.169892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e87de-6b0f-4111-af7d-6a61e309ffd1 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.170385 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e87de-6b0f-4111-af7d-6a61e309ffd1 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.170916 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e87de-6b0f-4111-af7d-6a61e309ffd1 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.173376 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 57/113] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:04.174388 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e87de-6b0f-4111-af7d-6a61e309ffd1 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:04.225354 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:04.332132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e87de-6b0f-4111-af7d-6a61e309ffd1 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:04.378485 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb2765-52a5-436b-b2d9-3489d29f5cf3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:04.382759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe989da-942b-4bb4-a603-c10ac0bfce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:04.383923 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe989da-942b-4bb4-a603-c10ac0bfce32 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.384396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe989da-942b-4bb4-a603-c10ac0bfce32 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.384815 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe989da-942b-4bb4-a603-c10ac0bfce32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.399443 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe989da-942b-4bb4-a603-c10ac0bfce32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-2fe989da-942b-4bb4-a603-c10ac0bfce32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:04.404743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:04.405655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:04.406470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 58/114] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:04.407105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe989da-942b-4bb4-a603-c10ac0bfce32 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:04.440747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345962c-c2a2-4f1a-93e9-a86a10245afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:04.441687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345962c-c2a2-4f1a-93e9-a86a10245afe None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.441974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345962c-c2a2-4f1a-93e9-a86a10245afe None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.442375 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345962c-c2a2-4f1a-93e9-a86a10245afe None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.455925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345962c-c2a2-4f1a-93e9-a86a10245afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9345962c-c2a2-4f1a-93e9-a86a10245afe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:04.462721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:04.463602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:04.464471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:04.465133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 57/115] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:04.466859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351a6a-79cf-4200-91a5-eff556d36b77 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.467386 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351a6a-79cf-4200-91a5-eff556d36b77 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.468144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351a6a-79cf-4200-91a5-eff556d36b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.500825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-82351a6a-79cf-4200-91a5-eff556d36b77 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:04.502677 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-82351a6a-79cf-4200-91a5-eff556d36b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:04.549963 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:04.569318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:04.580199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe989da-942b-4bb4-a603-c10ac0bfce32 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:04.596105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 58/116] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:04.597919 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8353dc-c11d-4607-8770-0d087840cc1d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.598413 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8353dc-c11d-4607-8770-0d087840cc1d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.598907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8353dc-c11d-4607-8770-0d087840cc1d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.600414 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 59/117] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:04.601388 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8353dc-c11d-4607-8770-0d087840cc1d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:04.641428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:04.643274 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.643794 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.644268 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.645267 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] RBAC: Adding query filter params (role.id=08de461272ef44ab9862da985703cb23, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08, user.id=16b06cb9bec24e709ca66715aa644dc3) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:04.645806 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:04.647488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:04.656248 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 59/118] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:04 2022] GET /identity/v3/role_assignments?user.id=16b06cb9bec24e709ca66715aa644dc3&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=08de461272ef44ab9862da985703cb23 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:04.658016 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:04.902532 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8353dc-c11d-4607-8770-0d087840cc1d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:04.979177 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0b754-0460-42de-b2f7-461083242cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:04.980698 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b754-0460-42de-b2f7-461083242cba None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.981472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b754-0460-42de-b2f7-461083242cba None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.982317 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b754-0460-42de-b2f7-461083242cba None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.984002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0b754-0460-42de-b2f7-461083242cba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:04.984886 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0b754-0460-42de-b2f7-461083242cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:04.987870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0b754-0460-42de-b2f7-461083242cba None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:05.004399 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 60/119] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:05.007287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7be04-90d4-4bdc-b383-4471bd57c54c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:05.008209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7be04-90d4-4bdc-b383-4471bd57c54c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:05.008975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7be04-90d4-4bdc-b383-4471bd57c54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:05.020262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdedb6b-78b8-4e13-9b82-f36988c7a8e9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:05.043193 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-43d7be04-90d4-4bdc-b383-4471bd57c54c None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:05.045810 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-43d7be04-90d4-4bdc-b383-4471bd57c54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:05.101412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:05.102858 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:05.103812 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:05.104371 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:05.104927 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:05.109359 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:05.109958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:05.112954 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:05.152791 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 60/120] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:05.152791 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:05.197375 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 61/121] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:05.199786 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7be04-90d4-4bdc-b383-4471bd57c54c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:05.264126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:05.424387 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7be04-90d4-4bdc-b383-4471bd57c54c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:05.516448 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c04e2-e651-4d31-b6b5-35bf164398bb None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:05.525872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ae972-98e7-4727-98bd-794e32bca01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:05.526528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ae972-98e7-4727-98bd-794e32bca01b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:05.526812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ae972-98e7-4727-98bd-794e32bca01b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:05.527089 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ae972-98e7-4727-98bd-794e32bca01b None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:05.528249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ae972-98e7-4727-98bd-794e32bca01b None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:05.530996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ae972-98e7-4727-98bd-794e32bca01b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:05.532742 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 62/122] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:05 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:05.534576 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ae972-98e7-4727-98bd-794e32bca01b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:05.591584 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e916e3-1144-45e7-92d2-571e02e73011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:05.592242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e916e3-1144-45e7-92d2-571e02e73011 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:05.592516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e916e3-1144-45e7-92d2-571e02e73011 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:05.596772 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e916e3-1144-45e7-92d2-571e02e73011 None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:05.598594 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e916e3-1144-45e7-92d2-571e02e73011 None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:05.600123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e916e3-1144-45e7-92d2-571e02e73011 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:05.602175 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 61/123] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:05 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:05.608197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e916e3-1144-45e7-92d2-571e02e73011 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:05.608990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:05.802347 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:05.807292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ae972-98e7-4727-98bd-794e32bca01b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:05.834902 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e916e3-1144-45e7-92d2-571e02e73011 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:05.896697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0aeea-46d4-4ed1-a3b3-1cdc00e695b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:05.896697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0aeea-46d4-4ed1-a3b3-1cdc00e695b9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:05.896697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0aeea-46d4-4ed1-a3b3-1cdc00e695b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:05.896697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0aeea-46d4-4ed1-a3b3-1cdc00e695b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:05.903358 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0aeea-46d4-4ed1-a3b3-1cdc00e695b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:05.904154 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569e0e1-c3ce-4af8-ac34-1e7624ac6fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:05.904841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569e0e1-c3ce-4af8-ac34-1e7624ac6fc5 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:05.905126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569e0e1-c3ce-4af8-ac34-1e7624ac6fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:05.905403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569e0e1-c3ce-4af8-ac34-1e7624ac6fc5 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:05.906623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569e0e1-c3ce-4af8-ac34-1e7624ac6fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:05.908176 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569e0e1-c3ce-4af8-ac34-1e7624ac6fc5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:05.910096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 62/124] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:05 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:05.910698 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569e0e1-c3ce-4af8-ac34-1e7624ac6fc5 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-33f0aeea-46d4-4ed1-a3b3-1cdc00e695b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:05.914290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:05.915184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:05.915964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:05.918531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 63/125] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:05.919694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0aeea-46d4-4ed1-a3b3-1cdc00e695b9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:06.057919 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569e0e1-c3ce-4af8-ac34-1e7624ac6fc5 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:06.061776 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:06.076790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0aeea-46d4-4ed1-a3b3-1cdc00e695b9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:06.112231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08b40-2132-46ad-b2bf-5fe0adfe0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:06.112986 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08b40-2132-46ad-b2bf-5fe0adfe0da4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:06.113280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08b40-2132-46ad-b2bf-5fe0adfe0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:06.113596 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08b40-2132-46ad-b2bf-5fe0adfe0da4 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:06.114717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b08b40-2132-46ad-b2bf-5fe0adfe0da4 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:06.116515 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b08b40-2132-46ad-b2bf-5fe0adfe0da4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:06.119050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 63/126] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:05 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:06.119581 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08b40-2132-46ad-b2bf-5fe0adfe0da4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:06.135848 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a2bcb-ece0-43db-a016-296ccb98bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:06.137425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2bcb-ece0-43db-a016-296ccb98bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:06.138137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2bcb-ece0-43db-a016-296ccb98bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:06.138636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2bcb-ece0-43db-a016-296ccb98bfc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:06.153267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2bcb-ece0-43db-a016-296ccb98bfc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:06.155813 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-457a2bcb-ece0-43db-a016-296ccb98bfc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:06.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:06.162337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:06.163531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:06.171803 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 64/127] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:06.174098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a2bcb-ece0-43db-a016-296ccb98bfc5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:06.252134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08b40-2132-46ad-b2bf-5fe0adfe0da4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:06.295065 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21addae0-d8ce-47af-a12e-d61d4cfb0eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:06.295744 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21addae0-d8ce-47af-a12e-d61d4cfb0eed None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:06.296044 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21addae0-d8ce-47af-a12e-d61d4cfb0eed None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:06.296335 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21addae0-d8ce-47af-a12e-d61d4cfb0eed None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/users/f4818dd43b034eaeb350bdeba58b6cea/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:06.298961 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21addae0-d8ce-47af-a12e-d61d4cfb0eed None admin] RBAC: Authorizing `identity:create_grant(project_id=025a96e9ed2b499596ba4f54f4b8ab08, user_id=f4818dd43b034eaeb350bdeba58b6cea, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:06.300428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21addae0-d8ce-47af-a12e-d61d4cfb0eed None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:06.319592 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 64/128] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:06 2022] PUT /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/users/f4818dd43b034eaeb350bdeba58b6cea/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:06.326547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21addae0-d8ce-47af-a12e-d61d4cfb0eed None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:06.384739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a2bcb-ece0-43db-a016-296ccb98bfc5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:06.478750 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:06.479670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:06.480179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:06.480708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:06.481965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:06.482521 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:06.488693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:06.519517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 65/129] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:06.520515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:06.566462 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:06.578024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:06.609267 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21addae0-d8ce-47af-a12e-d61d4cfb0eed None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:06.681726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85b70-bde8-4734-9bde-9c3d169031eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:06.682430 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85b70-bde8-4734-9bde-9c3d169031eb None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:06.682714 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85b70-bde8-4734-9bde-9c3d169031eb None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:06.683052 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85b70-bde8-4734-9bde-9c3d169031eb None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/users/f4818dd43b034eaeb350bdeba58b6cea/roles/c4c1742a54eb440c9d94f137cb668187` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:06.689048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa85b70-bde8-4734-9bde-9c3d169031eb None admin] RBAC: Authorizing `identity:create_grant(project_id=025a96e9ed2b499596ba4f54f4b8ab08, user_id=f4818dd43b034eaeb350bdeba58b6cea, role_id=c4c1742a54eb440c9d94f137cb668187)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:06.690569 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa85b70-bde8-4734-9bde-9c3d169031eb None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:06.717447 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 65/130] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:06 2022] PUT /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/users/f4818dd43b034eaeb350bdeba58b6cea/roles/c4c1742a54eb440c9d94f137cb668187 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:06.718586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85b70-bde8-4734-9bde-9c3d169031eb None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:06.746771 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5ccb9-799f-4f7b-a37f-d90f02fe99cf None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:06.845190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:06.846174 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:06.846674 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:06.847150 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:06.848442 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:06.849019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:06.851594 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:06.890035 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 66/131] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:06.899851 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:07.060699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85b70-bde8-4734-9bde-9c3d169031eb None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.121511 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976d11-3ccc-4ba5-85ee-ee1c4edc8c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.122077 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976d11-3ccc-4ba5-85ee-ee1c4edc8c4e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.122364 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976d11-3ccc-4ba5-85ee-ee1c4edc8c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.122647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976d11-3ccc-4ba5-85ee-ee1c4edc8c4e None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.124856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:07.127116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f976d11-3ccc-4ba5-85ee-ee1c4edc8c4e None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.130463 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f976d11-3ccc-4ba5-85ee-ee1c4edc8c4e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:07.132389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 66/132] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:06 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:07.138078 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976d11-3ccc-4ba5-85ee-ee1c4edc8c4e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:07.167194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:07.180964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840b3e6-3c9d-4e41-8ccf-a5e642e25bce None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.239949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc917f6-8aa5-4aab-a586-6f6b21a8c438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.240765 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc917f6-8aa5-4aab-a586-6f6b21a8c438 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.241155 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc917f6-8aa5-4aab-a586-6f6b21a8c438 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.241652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc917f6-8aa5-4aab-a586-6f6b21a8c438 None admin] PATH_INFO: `/v3/users/4e344534c0524c1e81232c0c48cd6c1f` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.243159 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc917f6-8aa5-4aab-a586-6f6b21a8c438 None admin] RBAC: Authorizing `identity:get_user(user_id=4e344534c0524c1e81232c0c48cd6c1f)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.245353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc917f6-8aa5-4aab-a586-6f6b21a8c438 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:07.247591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 67/133] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:06 2022] GET /identity/v3/users/4e344534c0524c1e81232c0c48cd6c1f => generated 247 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:07.266704 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc917f6-8aa5-4aab-a586-6f6b21a8c438 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:07.315451 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976d11-3ccc-4ba5-85ee-ee1c4edc8c4e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.423657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b439d-9d29-4537-97cf-046eb17d086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.424218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b439d-9d29-4537-97cf-046eb17d086f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.424500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b439d-9d29-4537-97cf-046eb17d086f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.424804 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b439d-9d29-4537-97cf-046eb17d086f None admin] PATH_INFO: `/v3/projects/83bd00669fdc42abbc5807694c697c49` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.427242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b439d-9d29-4537-97cf-046eb17d086f None admin] RBAC: Authorizing `identity:get_project(project_id=83bd00669fdc42abbc5807694c697c49)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.428881 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b439d-9d29-4537-97cf-046eb17d086f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:07.431073 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 67/134] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:07 2022] GET /identity/v3/projects/83bd00669fdc42abbc5807694c697c49 => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:07.441783 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b439d-9d29-4537-97cf-046eb17d086f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:07.530762 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc917f6-8aa5-4aab-a586-6f6b21a8c438 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.624462 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa89c5-c9e5-4280-9219-1ac4b6b9ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.625150 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa89c5-c9e5-4280-9219-1ac4b6b9ff8b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.625432 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa89c5-c9e5-4280-9219-1ac4b6b9ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.625701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa89c5-c9e5-4280-9219-1ac4b6b9ff8b None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.627080 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa89c5-c9e5-4280-9219-1ac4b6b9ff8b None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.628572 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa89c5-c9e5-4280-9219-1ac4b6b9ff8b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:07.632941 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 68/135] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:07 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:07.638344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be13f70-6452-4d63-938a-d11e8edeee29 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.639183 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be13f70-6452-4d63-938a-d11e8edeee29 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.639872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be13f70-6452-4d63-938a-d11e8edeee29 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.642721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 69/136] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:07.645350 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be13f70-6452-4d63-938a-d11e8edeee29 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:07.648360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:07.682073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:07.689164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b439d-9d29-4537-97cf-046eb17d086f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.773458 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd367-4cb0-49f2-ab33-3bdc86b7ede6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.774166 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd367-4cb0-49f2-ab33-3bdc86b7ede6 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.774456 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd367-4cb0-49f2-ab33-3bdc86b7ede6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.774741 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd367-4cb0-49f2-ab33-3bdc86b7ede6 None admin] PATH_INFO: `/v3/projects/83bd00669fdc42abbc5807694c697c49/users/f4818dd43b034eaeb350bdeba58b6cea/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.776920 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd367-4cb0-49f2-ab33-3bdc86b7ede6 None admin] RBAC: Authorizing `identity:create_grant(project_id=83bd00669fdc42abbc5807694c697c49, user_id=f4818dd43b034eaeb350bdeba58b6cea, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.778409 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd367-4cb0-49f2-ab33-3bdc86b7ede6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:07.805792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 68/137] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:07 2022] PUT /identity/v3/projects/83bd00669fdc42abbc5807694c697c49/users/f4818dd43b034eaeb350bdeba58b6cea/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:07.806853 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b1b0-5f4a-486a-8208-3f7cb0177840 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.807161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b1b0-5f4a-486a-8208-3f7cb0177840 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.807446 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b1b0-5f4a-486a-8208-3f7cb0177840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.862655 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-b317b1b0-5f4a-486a-8208-3f7cb0177840 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:07.863915 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b317b1b0-5f4a-486a-8208-3f7cb0177840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:07.892082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be13f70-6452-4d63-938a-d11e8edeee29 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.987486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7262e2c-fd96-477f-9a7d-0b4d4d2b17a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.988089 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262e2c-fd96-477f-9a7d-0b4d4d2b17a8 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.988373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262e2c-fd96-477f-9a7d-0b4d4d2b17a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.988688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262e2c-fd96-477f-9a7d-0b4d4d2b17a8 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/users/4e344534c0524c1e81232c0c48cd6c1f/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.995219 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7262e2c-fd96-477f-9a7d-0b4d4d2b17a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=025a96e9ed2b499596ba4f54f4b8ab08, user_id=4e344534c0524c1e81232c0c48cd6c1f, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.997063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7262e2c-fd96-477f-9a7d-0b4d4d2b17a8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:08.020379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 70/138] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:07 2022] PUT /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/users/4e344534c0524c1e81232c0c48cd6c1f/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:08.022437 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438e9a-2508-4a83-b3c2-61494d818d62 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:08.022734 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438e9a-2508-4a83-b3c2-61494d818d62 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:08.023014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e438e9a-2508-4a83-b3c2-61494d818d62 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:08.025265 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 71/139] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:08.031209 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 69/140] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:08.033328 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b43cb8-2917-4ecf-ba43-da272c3149fe None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:08.033616 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b43cb8-2917-4ecf-ba43-da272c3149fe None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:08.033958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b43cb8-2917-4ecf-ba43-da272c3149fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:08.061894 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-97b43cb8-2917-4ecf-ba43-da272c3149fe None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:08.063114 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-97b43cb8-2917-4ecf-ba43-da272c3149fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:08.161993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 72/141] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:08.452007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317b1b0-5f4a-486a-8208-3f7cb0177840 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:08.594142 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:08.652371 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b43cb8-2917-4ecf-ba43-da272c3149fe None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:08.667953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:08.696266 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317b1b0-5f4a-486a-8208-3f7cb0177840 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:08.807216 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da037a-6e25-4bd9-b9d9-7e4c54997c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:08.807793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da037a-6e25-4bd9-b9d9-7e4c54997c11 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:08.808079 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da037a-6e25-4bd9-b9d9-7e4c54997c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:08.808362 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da037a-6e25-4bd9-b9d9-7e4c54997c11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:08.809747 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da037a-6e25-4bd9-b9d9-7e4c54997c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:08.811237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da037a-6e25-4bd9-b9d9-7e4c54997c11 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:08.812898 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 70/142] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:08.820223 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da037a-6e25-4bd9-b9d9-7e4c54997c11 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:08.992628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b43cb8-2917-4ecf-ba43-da272c3149fe None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:09.078804 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baf81e-7a8f-4c40-a945-660657e0dd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:09.079507 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf81e-7a8f-4c40-a945-660657e0dd2f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:09.079790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf81e-7a8f-4c40-a945-660657e0dd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:09.080063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf81e-7a8f-4c40-a945-660657e0dd2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:09.103310 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da037a-6e25-4bd9-b9d9-7e4c54997c11 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:09.106489 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baf81e-7a8f-4c40-a945-660657e0dd2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-86baf81e-7a8f-4c40-a945-660657e0dd2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:09.112023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:09.112981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:09.114239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 73/143] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:09.125019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baf81e-7a8f-4c40-a945-660657e0dd2f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:09.185562 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74a1b-7010-48a9-a7e7-7d892c33aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:09.186202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74a1b-7010-48a9-a7e7-7d892c33aa04 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:09.186494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74a1b-7010-48a9-a7e7-7d892c33aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:09.186771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74a1b-7010-48a9-a7e7-7d892c33aa04 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:09.187455 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a74a1b-7010-48a9-a7e7-7d892c33aa04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:09.193133 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a74a1b-7010-48a9-a7e7-7d892c33aa04 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:09.213068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:09.226574 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:09.235783 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 71/144] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:52:08 2022] POST /identity/v3/users => generated 283 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:52:09.287382 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baf81e-7a8f-4c40-a945-660657e0dd2f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:09.335714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:09.336263 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:09.336585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:09.336893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:09.337584 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:09.337940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:09.339447 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:09.354288 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 74/145] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:09.360983 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74a1b-7010-48a9-a7e7-7d892c33aa04 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:09.523995 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74a1b-7010-48a9-a7e7-7d892c33aa04 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:09.568145 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e1f98-2ef3-425c-a696-ca25998e1935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:09.568859 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e1f98-2ef3-425c-a696-ca25998e1935 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:09.569147 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e1f98-2ef3-425c-a696-ca25998e1935 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:09.569429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e1f98-2ef3-425c-a696-ca25998e1935 None admin] PATH_INFO: `/v3/users/16b06cb9bec24e709ca66715aa644dc3` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:09.573589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e1f98-2ef3-425c-a696-ca25998e1935 None admin] RBAC: Authorizing `identity:get_user(user_id=16b06cb9bec24e709ca66715aa644dc3)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:09.575088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e1f98-2ef3-425c-a696-ca25998e1935 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:09.576846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 72/146] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:09 2022] GET /identity/v3/users/16b06cb9bec24e709ca66715aa644dc3 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:09.583354 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:09.739090 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd6e6-2b56-492c-a517-0a07ee0fbf6a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:09.772052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:09.787379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e3bf4-2fad-496c-aa96-7376a12c3b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:09.788046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e3bf4-2fad-496c-aa96-7376a12c3b77 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:09.788331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e3bf4-2fad-496c-aa96-7376a12c3b77 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:09.788611 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e3bf4-2fad-496c-aa96-7376a12c3b77 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:09.790930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e3bf4-2fad-496c-aa96-7376a12c3b77 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:09.792484 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e3bf4-2fad-496c-aa96-7376a12c3b77 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:09.794413 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 75/147] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:09 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:09.801082 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e1f98-2ef3-425c-a696-ca25998e1935 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:09.883197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5398033-b422-4563-aa2a-d25f175f6993 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:09.883519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5398033-b422-4563-aa2a-d25f175f6993 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:09.883756 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5398033-b422-4563-aa2a-d25f175f6993 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:09.885392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 76/148] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:09.895644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075c0a1-a7ae-4ec7-a69e-ff1fcf94e0de None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:09.895960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075c0a1-a7ae-4ec7-a69e-ff1fcf94e0de None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:09.896200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075c0a1-a7ae-4ec7-a69e-ff1fcf94e0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:09.897176 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:09.957619 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e075c0a1-a7ae-4ec7-a69e-ff1fcf94e0de None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:09.959548 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e075c0a1-a7ae-4ec7-a69e-ff1fcf94e0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:10.035128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e1f98-2ef3-425c-a696-ca25998e1935 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:10.074959 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681edb11-44f6-4acf-8b22-c70925f12734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:10.075635 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681edb11-44f6-4acf-8b22-c70925f12734 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:10.075922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681edb11-44f6-4acf-8b22-c70925f12734 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:10.076203 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681edb11-44f6-4acf-8b22-c70925f12734 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/users/16b06cb9bec24e709ca66715aa644dc3/roles/08de461272ef44ab9862da985703cb23` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:10.078242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681edb11-44f6-4acf-8b22-c70925f12734 None admin] RBAC: Authorizing `identity:create_grant(project_id=025a96e9ed2b499596ba4f54f4b8ab08, user_id=16b06cb9bec24e709ca66715aa644dc3, role_id=08de461272ef44ab9862da985703cb23)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:10.080272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681edb11-44f6-4acf-8b22-c70925f12734 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:10.098914 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 73/149] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:09 2022] PUT /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/users/16b06cb9bec24e709ca66715aa644dc3/roles/08de461272ef44ab9862da985703cb23 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:10.134749 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 77/150] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:10.563539 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d79a-87e6-45bf-a4f7-45ce38e0bed9 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:10.564054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d79a-87e6-45bf-a4f7-45ce38e0bed9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:10.564514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d79a-87e6-45bf-a4f7-45ce38e0bed9 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:10.567245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 74/151] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:10.573018 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506139-d86d-425e-8a55-a4d80c85fd57 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:10.573309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506139-d86d-425e-8a55-a4d80c85fd57 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:10.573596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506139-d86d-425e-8a55-a4d80c85fd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:10.598032 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-62506139-d86d-425e-8a55-a4d80c85fd57 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:10.598978 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7d79a-87e6-45bf-a4f7-45ce38e0bed9 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:10.611764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-62506139-d86d-425e-8a55-a4d80c85fd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:10.765246 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 78/152] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:10.794068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7d79a-87e6-45bf-a4f7-45ce38e0bed9 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:10.841142 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:10.882137 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6364a16-ada9-4656-84a3-3a3d307cc9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:10.883195 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364a16-ada9-4656-84a3-3a3d307cc9d1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:10.883707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364a16-ada9-4656-84a3-3a3d307cc9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:10.884205 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364a16-ada9-4656-84a3-3a3d307cc9d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:10.920488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6364a16-ada9-4656-84a3-3a3d307cc9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a6364a16-ada9-4656-84a3-3a3d307cc9d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:10.926434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:10.927346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:10.928892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 75/153] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:10.937865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62506139-d86d-425e-8a55-a4d80c85fd57 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:11.024212 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:11.087748 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62506139-d86d-425e-8a55-a4d80c85fd57 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:11.137883 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:11.138431 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:11.138710 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:11.138985 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:11.139666 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:11.139967 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:11.141969 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:11.157920 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 79/154] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:11.164149 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6364a16-ada9-4656-84a3-3a3d307cc9d1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:11.324949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6364a16-ada9-4656-84a3-3a3d307cc9d1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:11.369587 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d1ad-5390-4637-9207-ede7eebf387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:11.370420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d1ad-5390-4637-9207-ede7eebf387b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:11.370719 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d1ad-5390-4637-9207-ede7eebf387b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:11.371001 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d1ad-5390-4637-9207-ede7eebf387b None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:11.372433 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182d1ad-5390-4637-9207-ede7eebf387b None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:11.374026 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182d1ad-5390-4637-9207-ede7eebf387b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:11.376653 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 76/155] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:11 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:11.383437 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:11.490583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d1ad-5390-4637-9207-ede7eebf387b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:11.544797 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742ac78-a832-4c30-9ddf-b7a805f0d5d7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:11.574205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:11.619568 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf0f05-4d08-4ea9-87ad-958b4953d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:11.620198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf0f05-4d08-4ea9-87ad-958b4953d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:11.620481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf0f05-4d08-4ea9-87ad-958b4953d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:11.620784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf0f05-4d08-4ea9-87ad-958b4953d4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:11.628952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:11.770848 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d1ad-5390-4637-9207-ede7eebf387b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:11.785354 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf0f05-4d08-4ea9-87ad-958b4953d4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:11.789919 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf0f05-4d08-4ea9-87ad-958b4953d4d9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:11.888886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1aa71-fe14-4ec8-bcf9-b8b140e076f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:11.888886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1aa71-fe14-4ec8-bcf9-b8b140e076f9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:11.888886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1aa71-fe14-4ec8-bcf9-b8b140e076f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:11.888886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1aa71-fe14-4ec8-bcf9-b8b140e076f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1aa71-fe14-4ec8-bcf9-b8b140e076f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-36e1aa71-fe14-4ec8-bcf9-b8b140e076f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:11.932696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:11.934381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:11.936074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 77/156] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:11.940171 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fca0d-acb2-4c4b-8894-6c3b8f0be430 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:11.940171 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fca0d-acb2-4c4b-8894-6c3b8f0be430 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:11.940171 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fca0d-acb2-4c4b-8894-6c3b8f0be430 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:11.941558 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 78/157] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:11.977807 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fca0d-acb2-4c4b-8894-6c3b8f0be430 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:12.104649 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 80/158] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:12.107009 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ee30-09f7-443f-ad32-00464508e107 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:12.107530 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ee30-09f7-443f-ad32-00464508e107 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:12.108130 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ee30-09f7-443f-ad32-00464508e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:12.129619 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a9c7ee30-09f7-443f-ad32-00464508e107 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:12.131211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a9c7ee30-09f7-443f-ad32-00464508e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:12.143725 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:12.230754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 81/159] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:12.232022 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7ee30-09f7-443f-ad32-00464508e107 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:12.289406 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fca0d-acb2-4c4b-8894-6c3b8f0be430 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:12.316016 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:12.390542 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:12.391099 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:12.391915 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:12.392194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:12.392937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:12.393245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:12.394876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:12.416502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 79/160] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:12.417309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7ee30-09f7-443f-ad32-00464508e107 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:12.425296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:12.504292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6479db-e48b-4fe4-8e84-34961ae3fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:12.504974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6479db-e48b-4fe4-8e84-34961ae3fb89 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:12.505252 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6479db-e48b-4fe4-8e84-34961ae3fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:12.505522 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6479db-e48b-4fe4-8e84-34961ae3fb89 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:12.509549 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6479db-e48b-4fe4-8e84-34961ae3fb89 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:12.511223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6479db-e48b-4fe4-8e84-34961ae3fb89 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:12.513345 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 82/161] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:12 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:12.522339 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6479db-e48b-4fe4-8e84-34961ae3fb89 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:12.559473 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:12.622293 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82234459-9b44-4d32-82f5-ae428a13b15b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:12.672745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6479db-e48b-4fe4-8e84-34961ae3fb89 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:12.691331 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe67690-2da0-41ed-a1cd-db560bc25e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:12.692224 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe67690-2da0-41ed-a1cd-db560bc25e0f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:12.692224 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe67690-2da0-41ed-a1cd-db560bc25e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:12.696707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe67690-2da0-41ed-a1cd-db560bc25e0f None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:12.696707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe67690-2da0-41ed-a1cd-db560bc25e0f None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:12.697669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe67690-2da0-41ed-a1cd-db560bc25e0f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:12.699362 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 80/162] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:12 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:12.705832 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe67690-2da0-41ed-a1cd-db560bc25e0f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:12.723713 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:12.724580 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:12.725015 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:12.725423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:12.726315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] RBAC: Adding query filter params (role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08, user.id=f4818dd43b034eaeb350bdeba58b6cea) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:12.726760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:12.728420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:12.739607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 83/163] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:12 2022] GET /identity/v3/role_assignments?user.id=f4818dd43b034eaeb350bdeba58b6cea&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:12.781457 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:12.801681 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:12.881143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe67690-2da0-41ed-a1cd-db560bc25e0f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:12.935273 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:12.965116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c2c44-8103-4cc7-a8e8-38999fb36d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:12.965763 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c2c44-8103-4cc7-a8e8-38999fb36d14 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:12.966046 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c2c44-8103-4cc7-a8e8-38999fb36d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:12.966320 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c2c44-8103-4cc7-a8e8-38999fb36d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:12.972191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a825c-196e-4156-a14d-85e4de5ca860 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:13.036534 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dd16f-e995-4dad-b9c7-54a3a471792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:13.037242 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd16f-e995-4dad-b9c7-54a3a471792a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:13.037521 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd16f-e995-4dad-b9c7-54a3a471792a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:13.037799 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd16f-e995-4dad-b9c7-54a3a471792a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:13.056760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dd16f-e995-4dad-b9c7-54a3a471792a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-721dd16f-e995-4dad-b9c7-54a3a471792a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:13.062257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:13.063784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:13.064706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 84/164] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:52:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:13.073109 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d337c8b-339a-4e1c-9f3e-5923e01791f4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:13.073449 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d337c8b-339a-4e1c-9f3e-5923e01791f4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:13.073666 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d337c8b-339a-4e1c-9f3e-5923e01791f4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:13.075394 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 85/165] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:13.076104 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d337c8b-339a-4e1c-9f3e-5923e01791f4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:13.151325 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c2c44-8103-4cc7-a8e8-38999fb36d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:13.152842 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c2c44-8103-4cc7-a8e8-38999fb36d14 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:13.238210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:13.303971 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d337c8b-339a-4e1c-9f3e-5923e01791f4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:13.354384 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 81/166] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:52:13.357509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1d94a-5809-48cb-bcbf-0bc6fc1b6cd6 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:13.357802 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1d94a-5809-48cb-bcbf-0bc6fc1b6cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:13.358080 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1d94a-5809-48cb-bcbf-0bc6fc1b6cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:13.375084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:13.375753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:13.376033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:13.376307 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:13.377010 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:13.377311 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:13.378734 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:13.387074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-29c1d94a-5809-48cb-bcbf-0bc6fc1b6cd6 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:13.388291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-29c1d94a-5809-48cb-bcbf-0bc6fc1b6cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:13.393072 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:13.402245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 86/167] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:13.402958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:13.550301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 82/168] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:13.551139 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1d94a-5809-48cb-bcbf-0bc6fc1b6cd6 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:13.601114 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32381ad3-4cfd-47e1-8f35-c1f7d658bc32 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:13.704561 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb657-a504-4d77-8d77-525263397f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:13.705244 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb657-a504-4d77-8d77-525263397f74 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:13.705520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb657-a504-4d77-8d77-525263397f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:13.705787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb657-a504-4d77-8d77-525263397f74 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:13.706974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cb657-a504-4d77-8d77-525263397f74 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:13.708454 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cb657-a504-4d77-8d77-525263397f74 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:13.710598 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 87/169] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:13 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:13.719522 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb657-a504-4d77-8d77-525263397f74 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:13.743865 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:13.806631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1d94a-5809-48cb-bcbf-0bc6fc1b6cd6 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:13.885523 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:13.940697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb657-a504-4d77-8d77-525263397f74 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:13.957903 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7625f-0516-404d-9b16-2a7973bf17cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:13.958106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7625f-0516-404d-9b16-2a7973bf17cd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:13.958362 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7625f-0516-404d-9b16-2a7973bf17cd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:13.958658 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7625f-0516-404d-9b16-2a7973bf17cd None admin] PATH_INFO: `/v3/users/4e344534c0524c1e81232c0c48cd6c1f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:13.965503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7625f-0516-404d-9b16-2a7973bf17cd None admin] RBAC: Authorizing `identity:get_user(user_id=4e344534c0524c1e81232c0c48cd6c1f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:13.967009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7625f-0516-404d-9b16-2a7973bf17cd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:13.972868 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 83/170] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:13 2022] GET /identity/v3/users/4e344534c0524c1e81232c0c48cd6c1f => generated 247 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:13.989821 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7625f-0516-404d-9b16-2a7973bf17cd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:14.009415 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:14.010057 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:14.010340 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:14.010614 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:14.011356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] RBAC: Adding query filter params (role.id=c4c1742a54eb440c9d94f137cb668187, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08, user.id=f4818dd43b034eaeb350bdeba58b6cea) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:14.011662 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:14.013355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:14.026982 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 88/171] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:13 2022] GET /identity/v3/role_assignments?user.id=f4818dd43b034eaeb350bdeba58b6cea&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=c4c1742a54eb440c9d94f137cb668187 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:14.193369 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7625f-0516-404d-9b16-2a7973bf17cd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:14.237999 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538f1a3-09ef-4285-8def-bf0f4699942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:14.238617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f1a3-09ef-4285-8def-bf0f4699942c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:14.238894 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f1a3-09ef-4285-8def-bf0f4699942c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:14.239164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f1a3-09ef-4285-8def-bf0f4699942c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:14.255183 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:14.345330 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538f1a3-09ef-4285-8def-bf0f4699942c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:14.346819 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538f1a3-09ef-4285-8def-bf0f4699942c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:14.479932 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 84/172] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:14.486343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:14.518514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538f1a3-09ef-4285-8def-bf0f4699942c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:14.602156 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:14.706122 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538f1a3-09ef-4285-8def-bf0f4699942c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:14.756338 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ca1a-f181-4fca-af37-b64641e34ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:14.757795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ca1a-f181-4fca-af37-b64641e34ac3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:14.758462 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ca1a-f181-4fca-af37-b64641e34ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:14.758944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ca1a-f181-4fca-af37-b64641e34ac3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:14.772455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d5fdd-f2af-4ef4-9187-9be6f479f4d7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:14.773014 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ca1a-f181-4fca-af37-b64641e34ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-55f1ca1a-f181-4fca-af37-b64641e34ac3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:14.780850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:14.781811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:14.782726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:14.785433 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 85/173] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:14.788073 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d89b20-eb61-45a3-a3b8-d722f009eb57 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:14.788610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d89b20-eb61-45a3-a3b8-d722f009eb57 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:14.789120 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d89b20-eb61-45a3-a3b8-d722f009eb57 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:14.796693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 86/174] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:14.799429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d89b20-eb61-45a3-a3b8-d722f009eb57 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:14.889190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:14.910652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b69017-ea9f-4e93-8bee-ecb9fa608bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:14.911296 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69017-ea9f-4e93-8bee-ecb9fa608bda None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:14.911734 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69017-ea9f-4e93-8bee-ecb9fa608bda None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:14.912169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69017-ea9f-4e93-8bee-ecb9fa608bda None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:14.916226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b69017-ea9f-4e93-8bee-ecb9fa608bda None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:14.917286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b69017-ea9f-4e93-8bee-ecb9fa608bda None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:14.920145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 89/175] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:14 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:14.926406 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148bf00-b025-4cbe-8462-cad76387c2c8 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:14.926849 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148bf00-b025-4cbe-8462-cad76387c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:14.927265 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148bf00-b025-4cbe-8462-cad76387c2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:14.962235 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-c148bf00-b025-4cbe-8462-cad76387c2c8 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:14.962425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d89b20-eb61-45a3-a3b8-d722f009eb57 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:14.964387 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c148bf00-b025-4cbe-8462-cad76387c2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:14.989962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:15.029447 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4119d65-cdd8-4f78-842b-989773516635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:15.030400 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119d65-cdd8-4f78-842b-989773516635 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.030867 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119d65-cdd8-4f78-842b-989773516635 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.031352 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4119d65-cdd8-4f78-842b-989773516635 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.033314 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4119d65-cdd8-4f78-842b-989773516635 None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:15.033861 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4119d65-cdd8-4f78-842b-989773516635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:15.036851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4119d65-cdd8-4f78-842b-989773516635 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:15.047254 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 90/176] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:15.049347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1bcd-673d-4e9c-b53b-6a89f7b7cb07 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.049772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1bcd-673d-4e9c-b53b-6a89f7b7cb07 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.050205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1bcd-673d-4e9c-b53b-6a89f7b7cb07 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.051633 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 91/177] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:15.052493 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c1bcd-673d-4e9c-b53b-6a89f7b7cb07 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:15.067081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 87/178] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:15.067081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b934f-237b-4c3e-bc7a-4121bb4b8f35 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.067081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b934f-237b-4c3e-bc7a-4121bb4b8f35 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.067081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b934f-237b-4c3e-bc7a-4121bb4b8f35 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.069100 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 88/179] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:15.071515 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8dd0-1bdc-4c28-b67a-99907ac0162c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.072006 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8dd0-1bdc-4c28-b67a-99907ac0162c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.072518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8dd0-1bdc-4c28-b67a-99907ac0162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.101490 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-20cc8dd0-1bdc-4c28-b67a-99907ac0162c None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:15.102901 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-20cc8dd0-1bdc-4c28-b67a-99907ac0162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:15.188284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 89/180] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:15.193121 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c1bcd-673d-4e9c-b53b-6a89f7b7cb07 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:15.197776 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8dd0-1bdc-4c28-b67a-99907ac0162c None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:15.233308 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:15.236468 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abed8c9-3ebd-4a5b-a683-52acd14978e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:15.237335 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abed8c9-3ebd-4a5b-a683-52acd14978e8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.237891 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abed8c9-3ebd-4a5b-a683-52acd14978e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.238358 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abed8c9-3ebd-4a5b-a683-52acd14978e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.239318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abed8c9-3ebd-4a5b-a683-52acd14978e8 None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08, user.id=4e344534c0524c1e81232c0c48cd6c1f) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:15.239730 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abed8c9-3ebd-4a5b-a683-52acd14978e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:15.241506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abed8c9-3ebd-4a5b-a683-52acd14978e8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:15.248898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 92/181] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:15 2022] GET /identity/v3/role_assignments?user.id=4e344534c0524c1e81232c0c48cd6c1f&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:15.251162 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba84882-6d82-4224-9ba4-9a934bee2a7b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.251556 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba84882-6d82-4224-9ba4-9a934bee2a7b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.251964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba84882-6d82-4224-9ba4-9a934bee2a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.273751 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-0ba84882-6d82-4224-9ba4-9a934bee2a7b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:15.275170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-0ba84882-6d82-4224-9ba4-9a934bee2a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:15.359230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 93/182] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:15.382135 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:15.392851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8dd0-1bdc-4c28-b67a-99907ac0162c None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:15.433667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac08f-876f-425b-b0df-3e933f159a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:15.434355 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac08f-876f-425b-b0df-3e933f159a9b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.434645 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac08f-876f-425b-b0df-3e933f159a9b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.434922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac08f-876f-425b-b0df-3e933f159a9b None admin] PATH_INFO: `/v3/users/f4818dd43b034eaeb350bdeba58b6cea` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.436337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aac08f-876f-425b-b0df-3e933f159a9b None admin] RBAC: Authorizing `identity:get_user(user_id=f4818dd43b034eaeb350bdeba58b6cea)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:15.438005 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aac08f-876f-425b-b0df-3e933f159a9b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:15.439931 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 90/183] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:15 2022] GET /identity/v3/users/f4818dd43b034eaeb350bdeba58b6cea => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:15.449858 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba84882-6d82-4224-9ba4-9a934bee2a7b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:15.605289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba84882-6d82-4224-9ba4-9a934bee2a7b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:15.621319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac08f-876f-425b-b0df-3e933f159a9b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:15.632293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:15.646161 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2245d0-8224-4b90-8526-49cd082d7f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:15.646787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2245d0-8224-4b90-8526-49cd082d7f37 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.647074 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2245d0-8224-4b90-8526-49cd082d7f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.647348 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2245d0-8224-4b90-8526-49cd082d7f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.722776 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2245d0-8224-4b90-8526-49cd082d7f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:15.724330 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2245d0-8224-4b90-8526-49cd082d7f37 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:15.746151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac08f-876f-425b-b0df-3e933f159a9b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:15.793249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08472-80b2-405d-bbaa-7471f1d8afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:15.795179 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08472-80b2-405d-bbaa-7471f1d8afe3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.795917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08472-80b2-405d-bbaa-7471f1d8afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.796429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08472-80b2-405d-bbaa-7471f1d8afe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.816520 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd08472-80b2-405d-bbaa-7471f1d8afe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0fd08472-80b2-405d-bbaa-7471f1d8afe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:15.823210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:15.824477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:15.825641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:15.834917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 91/184] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:52:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:15.837204 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668ca55-5aaf-4854-8800-bd29bd13e1f1 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.837953 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668ca55-5aaf-4854-8800-bd29bd13e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.838466 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668ca55-5aaf-4854-8800-bd29bd13e1f1 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.840485 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 92/185] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:15.842287 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668ca55-5aaf-4854-8800-bd29bd13e1f1 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:15.845757 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 94/186] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:15.847124 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c92af-fe10-4cf3-9c18-40fc5f5e8567 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.847409 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c92af-fe10-4cf3-9c18-40fc5f5e8567 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.847683 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c92af-fe10-4cf3-9c18-40fc5f5e8567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.866480 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bd2c92af-fe10-4cf3-9c18-40fc5f5e8567 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:15.867726 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bd2c92af-fe10-4cf3-9c18-40fc5f5e8567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:15.877104 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:15.887105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:15.965361 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 95/187] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:15.973425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c92af-fe10-4cf3-9c18-40fc5f5e8567 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:15.984464 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668ca55-5aaf-4854-8800-bd29bd13e1f1 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.030178 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.031220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.031721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.032215 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.033489 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:16.034042 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:16.036725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:16.051698 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 93/188] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:16.054354 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:16.122672 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c92af-fe10-4cf3-9c18-40fc5f5e8567 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.170547 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e285f-41d9-4842-a6d8-71cf7c713ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.171084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e285f-41d9-4842-a6d8-71cf7c713ceb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.171367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e285f-41d9-4842-a6d8-71cf7c713ceb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.171641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e285f-41d9-4842-a6d8-71cf7c713ceb None admin] PATH_INFO: `/v3/projects/83bd00669fdc42abbc5807694c697c49` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.173405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e285f-41d9-4842-a6d8-71cf7c713ceb None admin] RBAC: Authorizing `identity:get_project(project_id=83bd00669fdc42abbc5807694c697c49)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:16.174962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e285f-41d9-4842-a6d8-71cf7c713ceb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:16.176716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 96/189] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:15 2022] GET /identity/v3/projects/83bd00669fdc42abbc5807694c697c49 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:16.177518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e285f-41d9-4842-a6d8-71cf7c713ceb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:16.191554 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:16.203835 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:16.225892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31776968-30f7-4595-a871-ddd360b4e02c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.287559 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002fed6-8017-4460-bcda-2caa9f776324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.288370 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fed6-8017-4460-bcda-2caa9f776324 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.288913 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fed6-8017-4460-bcda-2caa9f776324 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.289400 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fed6-8017-4460-bcda-2caa9f776324 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.302893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e285f-41d9-4842-a6d8-71cf7c713ceb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.309867 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002fed6-8017-4460-bcda-2caa9f776324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d002fed6-8017-4460-bcda-2caa9f776324 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:16.320387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:16.321488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:16.322383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:16.323005 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 94/190] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:16.324046 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002fed6-8017-4460-bcda-2caa9f776324 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:16.345963 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d33b66-3c51-4f93-af81-302974e6ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.346620 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33b66-3c51-4f93-af81-302974e6ad68 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.346904 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33b66-3c51-4f93-af81-302974e6ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.347179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33b66-3c51-4f93-af81-302974e6ad68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.359459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d33b66-3c51-4f93-af81-302974e6ad68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-07d33b66-3c51-4f93-af81-302974e6ad68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:16.364939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:16.366575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:16.367651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 97/191] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:16.370177 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d33b66-3c51-4f93-af81-302974e6ad68 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:16.469210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:16.470922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002fed6-8017-4460-bcda-2caa9f776324 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.492966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d33b66-3c51-4f93-af81-302974e6ad68 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.515288 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f1db7-2242-4592-9ae5-542fe52d3de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.516121 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1db7-2242-4592-9ae5-542fe52d3de9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.516508 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1db7-2242-4592-9ae5-542fe52d3de9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.516890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1db7-2242-4592-9ae5-542fe52d3de9 None admin] PATH_INFO: `/v3/users/c0e587926f0b43b2b5921cca5ae52c49` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.531015 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.531635 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.532408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.532706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.533445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] RBAC: Adding query filter params (role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=83bd00669fdc42abbc5807694c697c49, user.id=f4818dd43b034eaeb350bdeba58b6cea) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:16.534039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:16.534143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:16.535276 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:16.537037 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f1db7-2242-4592-9ae5-542fe52d3de9 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e587926f0b43b2b5921cca5ae52c49)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:16.539163 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f1db7-2242-4592-9ae5-542fe52d3de9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:16.541110 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 95/192] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/users/c0e587926f0b43b2b5921cca5ae52c49 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:16.542052 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f1db7-2242-4592-9ae5-542fe52d3de9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:16.542721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 98/193] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/role_assignments?user.id=f4818dd43b034eaeb350bdeba58b6cea&scope.project.id=83bd00669fdc42abbc5807694c697c49&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:16.543405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:16.698838 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cadd4-ef77-46a9-bf46-617a81910d0b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.710692 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f1db7-2242-4592-9ae5-542fe52d3de9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.753794 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.754562 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.755027 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.755315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.756002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:16.756312 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:16.757761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:16.760972 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc582b-4e0d-4674-84d7-0dacb40c0297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.761853 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc582b-4e0d-4674-84d7-0dacb40c0297 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.762352 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc582b-4e0d-4674-84d7-0dacb40c0297 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.762798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc582b-4e0d-4674-84d7-0dacb40c0297 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.764833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc582b-4e0d-4674-84d7-0dacb40c0297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:16.767189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc582b-4e0d-4674-84d7-0dacb40c0297 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:16.768519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 99/194] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:16.769383 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:16.774113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 96/195] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:16.775409 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc582b-4e0d-4674-84d7-0dacb40c0297 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:16.786319 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:16.881402 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:16.921797 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb537a9-3060-416f-b853-a518860426ee None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.928570 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc582b-4e0d-4674-84d7-0dacb40c0297 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:16.966087 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.966686 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.967623 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.967623 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.968054 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:16.968357 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:16.970413 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:16.973324 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585503-1a47-420e-82a3-d636aa76d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:16.974018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585503-1a47-420e-82a3-d636aa76d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:16.974358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585503-1a47-420e-82a3-d636aa76d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:16.974698 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4585503-1a47-420e-82a3-d636aa76d5d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:16.979391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 100/196] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:16.980252 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:17.053947 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:17.054703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4585503-1a47-420e-82a3-d636aa76d5d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:17.056608 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4585503-1a47-420e-82a3-d636aa76d5d6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:17.092265 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2a941-b46f-46b7-9244-970404f74ccd None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:17.133374 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c7ec0-dab9-4bb9-b1d3-55c801e89a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:17.134380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c7ec0-dab9-4bb9-b1d3-55c801e89a90 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:17.134839 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c7ec0-dab9-4bb9-b1d3-55c801e89a90 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:17.135641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c7ec0-dab9-4bb9-b1d3-55c801e89a90 None admin] PATH_INFO: `/v3/users/c0e587926f0b43b2b5921cca5ae52c49` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:17.137515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c7ec0-dab9-4bb9-b1d3-55c801e89a90 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e587926f0b43b2b5921cca5ae52c49)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:17.138754 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:17.139890 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c7ec0-dab9-4bb9-b1d3-55c801e89a90 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:17.143881 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 101/197] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/users/c0e587926f0b43b2b5921cca5ae52c49 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:17.144938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c7ec0-dab9-4bb9-b1d3-55c801e89a90 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:17.184155 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 97/198] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:17.185076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585503-1a47-420e-82a3-d636aa76d5d6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:17.268502 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c7ec0-dab9-4bb9-b1d3-55c801e89a90 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:17.302126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4585503-1a47-420e-82a3-d636aa76d5d6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:17.309346 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e41aa-1a0f-477c-8d28-88b5761c7664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:17.309870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e41aa-1a0f-477c-8d28-88b5761c7664 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:17.310153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e41aa-1a0f-477c-8d28-88b5761c7664 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:17.310425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e41aa-1a0f-477c-8d28-88b5761c7664 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:17.311091 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e41aa-1a0f-477c-8d28-88b5761c7664 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:17.312604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e41aa-1a0f-477c-8d28-88b5761c7664 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:17.323200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:17.346882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 102/199] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:52:17 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:52:17.346882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e41aa-1a0f-477c-8d28-88b5761c7664 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:17.356826 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102e33e-d586-481f-a867-a42dceeae989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:17.357654 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102e33e-d586-481f-a867-a42dceeae989 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:17.357942 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102e33e-d586-481f-a867-a42dceeae989 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:17.358222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102e33e-d586-481f-a867-a42dceeae989 None admin] PATH_INFO: `/v3/users/16b06cb9bec24e709ca66715aa644dc3` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:17.359674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102e33e-d586-481f-a867-a42dceeae989 None admin] RBAC: Authorizing `identity:get_user(user_id=16b06cb9bec24e709ca66715aa644dc3)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:17.361391 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102e33e-d586-481f-a867-a42dceeae989 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:17.363249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 98/200] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:17 2022] GET /identity/v3/users/16b06cb9bec24e709ca66715aa644dc3 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:17.364142 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102e33e-d586-481f-a867-a42dceeae989 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:17.425697 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:17.512563 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e41aa-1a0f-477c-8d28-88b5761c7664 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:17.543214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102e33e-d586-481f-a867-a42dceeae989 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:17.567281 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91850-915b-458c-8a01-a5e95d6682b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:17.567902 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91850-915b-458c-8a01-a5e95d6682b9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:17.568189 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91850-915b-458c-8a01-a5e95d6682b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:17.568467 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91850-915b-458c-8a01-a5e95d6682b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:17.594997 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5fdda-751a-46c9-a293-5703961d90fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:17.595649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5fdda-751a-46c9-a293-5703961d90fd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:17.595985 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5fdda-751a-46c9-a293-5703961d90fd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:17.596261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5fdda-751a-46c9-a293-5703961d90fd None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:17.597503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5fdda-751a-46c9-a293-5703961d90fd None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:17.602738 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5fdda-751a-46c9-a293-5703961d90fd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:17.602738 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 99/201] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:17 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:17.602738 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5fdda-751a-46c9-a293-5703961d90fd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:17.673656 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:17.697265 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e91850-915b-458c-8a01-a5e95d6682b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:17.699271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e91850-915b-458c-8a01-a5e95d6682b9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:17.768213 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5fdda-751a-46c9-a293-5703961d90fd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:17.772683 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:17.820201 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144805c9-7ad2-4996-bc1d-e2a91f21c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:17.820772 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144805c9-7ad2-4996-bc1d-e2a91f21c129 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:17.821058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144805c9-7ad2-4996-bc1d-e2a91f21c129 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:17.821336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144805c9-7ad2-4996-bc1d-e2a91f21c129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:17.882443 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 103/202] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:17.887867 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91850-915b-458c-8a01-a5e95d6682b9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:17.931272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144805c9-7ad2-4996-bc1d-e2a91f21c129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:17.933876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144805c9-7ad2-4996-bc1d-e2a91f21c129 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:18.005995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:18.020162 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91850-915b-458c-8a01-a5e95d6682b9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:18.071145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:18.072520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:18.073011 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:18.073427 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:18.074306 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae, user.id=c0e587926f0b43b2b5921cca5ae52c49) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:18.074760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:18.076411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:18.085062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 104/203] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:17 2022] GET /identity/v3/role_assignments?user.id=c0e587926f0b43b2b5921cca5ae52c49&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:18.086099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:18.119837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 100/204] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:18.130438 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144805c9-7ad2-4996-bc1d-e2a91f21c129 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:18.143928 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:18.286590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144805c9-7ad2-4996-bc1d-e2a91f21c129 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:18.329787 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d2986-147b-4820-8b21-1108d3f68cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:18.330683 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d2986-147b-4820-8b21-1108d3f68cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:18.331108 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d2986-147b-4820-8b21-1108d3f68cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:18.331521 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d2986-147b-4820-8b21-1108d3f68cf3 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:18.333029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d2986-147b-4820-8b21-1108d3f68cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:18.334683 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d2986-147b-4820-8b21-1108d3f68cf3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:18.334804 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda4bd-65f5-4f38-afb8-73fc23b6e641 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:18.337280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 101/205] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:18 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:18.348198 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d2986-147b-4820-8b21-1108d3f68cf3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:18.379514 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c22025-65a3-429f-8274-f820cacc370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:18.381300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c22025-65a3-429f-8274-f820cacc370d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:18.381825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c22025-65a3-429f-8274-f820cacc370d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:18.382300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c22025-65a3-429f-8274-f820cacc370d None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:18.383735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c22025-65a3-429f-8274-f820cacc370d None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:18.386094 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c22025-65a3-429f-8274-f820cacc370d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:18.388136 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 105/206] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:18 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:18.395685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c22025-65a3-429f-8274-f820cacc370d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:18.432516 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:18.527320 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:18.578450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c22025-65a3-429f-8274-f820cacc370d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:18.598727 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d2986-147b-4820-8b21-1108d3f68cf3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:18.653370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9134019-cdb0-4c9e-bd0f-22d9e0d21503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:18.653988 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9134019-cdb0-4c9e-bd0f-22d9e0d21503 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:18.654268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9134019-cdb0-4c9e-bd0f-22d9e0d21503 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:18.654852 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9134019-cdb0-4c9e-bd0f-22d9e0d21503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:18.655589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9134019-cdb0-4c9e-bd0f-22d9e0d21503 None admin] RBAC: Adding query filter params (role.id=c4c1742a54eb440c9d94f137cb668187, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae, user.id=c0e587926f0b43b2b5921cca5ae52c49) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:18.655895 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9134019-cdb0-4c9e-bd0f-22d9e0d21503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:18.660772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9134019-cdb0-4c9e-bd0f-22d9e0d21503 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:18.675344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 106/207] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:18 2022] GET /identity/v3/role_assignments?user.id=c0e587926f0b43b2b5921cca5ae52c49&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=c4c1742a54eb440c9d94f137cb668187 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:18.676003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ea0f-cfce-4b76-a39e-4e09ae00da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:18.676644 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ea0f-cfce-4b76-a39e-4e09ae00da74 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:18.676976 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ea0f-cfce-4b76-a39e-4e09ae00da74 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:18.677248 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ea0f-cfce-4b76-a39e-4e09ae00da74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:18.678029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708ea0f-cfce-4b76-a39e-4e09ae00da74 None admin] RBAC: Adding query filter params (role.id=08de461272ef44ab9862da985703cb23, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08, user.id=16b06cb9bec24e709ca66715aa644dc3) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:18.678336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708ea0f-cfce-4b76-a39e-4e09ae00da74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:18.687378 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708ea0f-cfce-4b76-a39e-4e09ae00da74 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:18.687378 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 102/208] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:18 2022] GET /identity/v3/role_assignments?user.id=16b06cb9bec24e709ca66715aa644dc3&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=08de461272ef44ab9862da985703cb23 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:20.171974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f7356-aab3-4051-a864-6f4967e36f6c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:20.174046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f7356-aab3-4051-a864-6f4967e36f6c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:20.174780 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f7356-aab3-4051-a864-6f4967e36f6c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:20.177373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 107/209] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:20.183991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58f393-a0c4-42a0-9954-cf2ec0620820 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:20.185258 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58f393-a0c4-42a0-9954-cf2ec0620820 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:20.185771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58f393-a0c4-42a0-9954-cf2ec0620820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:20.212083 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ba58f393-a0c4-42a0-9954-cf2ec0620820 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:20.213945 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ba58f393-a0c4-42a0-9954-cf2ec0620820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:20.235983 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330980-0c2f-4497-bcc8-ebb73f4931f9 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:20.236343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330980-0c2f-4497-bcc8-ebb73f4931f9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:20.236507 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330980-0c2f-4497-bcc8-ebb73f4931f9 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:20.238080 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 108/210] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:20.243495 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc5e0-be45-4030-98de-7addae4da458 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:20.243765 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc5e0-be45-4030-98de-7addae4da458 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:20.244039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc5e0-be45-4030-98de-7addae4da458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:20.269823 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-857fc5e0-be45-4030-98de-7addae4da458 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:20.272932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-857fc5e0-be45-4030-98de-7addae4da458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:20.344782 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 103/211] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:20.391859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 109/212] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:20.860937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58f393-a0c4-42a0-9954-cf2ec0620820 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:20.947697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc5e0-be45-4030-98de-7addae4da458 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:20.984411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:20.997863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:21.070711 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58f393-a0c4-42a0-9954-cf2ec0620820 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:21.144452 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc5e0-be45-4030-98de-7addae4da458 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:21.162687 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb384d6-b665-4a6a-b4ac-4c1a7a289230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:21.163911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb384d6-b665-4a6a-b4ac-4c1a7a289230 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.164511 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb384d6-b665-4a6a-b4ac-4c1a7a289230 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.167373 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb384d6-b665-4a6a-b4ac-4c1a7a289230 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.168881 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb384d6-b665-4a6a-b4ac-4c1a7a289230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:21.170564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb384d6-b665-4a6a-b4ac-4c1a7a289230 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:21.172779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 104/213] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:52:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:21.180773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb384d6-b665-4a6a-b4ac-4c1a7a289230 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:21.214995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012426da-51d9-4ec5-ae9f-8508b4234737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:21.217102 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012426da-51d9-4ec5-ae9f-8508b4234737 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.218150 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012426da-51d9-4ec5-ae9f-8508b4234737 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.218811 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012426da-51d9-4ec5-ae9f-8508b4234737 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.238152 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012426da-51d9-4ec5-ae9f-8508b4234737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-012426da-51d9-4ec5-ae9f-8508b4234737 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:21.248766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:21.250324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:21.252377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:21.264989 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 110/214] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:21.268251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761837cf-55bc-49c2-9e65-d1496773e4ca None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.269332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761837cf-55bc-49c2-9e65-d1496773e4ca None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.270527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761837cf-55bc-49c2-9e65-d1496773e4ca None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.272901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 111/215] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:21.274096 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761837cf-55bc-49c2-9e65-d1496773e4ca None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:21.306837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb384d6-b665-4a6a-b4ac-4c1a7a289230 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:21.353220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6bff0-aef3-4173-a000-c98e4adfd6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:21.353821 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6bff0-aef3-4173-a000-c98e4adfd6c7 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.354100 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6bff0-aef3-4173-a000-c98e4adfd6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.354370 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6bff0-aef3-4173-a000-c98e4adfd6c7 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.355032 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6bff0-aef3-4173-a000-c98e4adfd6c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:21.356470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6bff0-aef3-4173-a000-c98e4adfd6c7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:21.364653 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:21.379550 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 105/216] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:52:21 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:52:21.381272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d0a0-8b06-4447-b165-80eec8384973 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.381561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d0a0-8b06-4447-b165-80eec8384973 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.381844 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d0a0-8b06-4447-b165-80eec8384973 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.383173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 106/217] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:21.384336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4af4d-12f6-4aa4-a8ce-fedd6abd6c46 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.384623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4af4d-12f6-4aa4-a8ce-fedd6abd6c46 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.384938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4af4d-12f6-4aa4-a8ce-fedd6abd6c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.405363 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:21.414231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8ed4af4d-12f6-4aa4-a8ce-fedd6abd6c46 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:21.415856 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8ed4af4d-12f6-4aa4-a8ce-fedd6abd6c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:21.439608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761837cf-55bc-49c2-9e65-d1496773e4ca None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:21.498735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635be910-7b43-4a3b-b986-e04d64ec0cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:21.499729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635be910-7b43-4a3b-b986-e04d64ec0cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.500193 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635be910-7b43-4a3b-b986-e04d64ec0cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.501250 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635be910-7b43-4a3b-b986-e04d64ec0cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.502416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635be910-7b43-4a3b-b986-e04d64ec0cb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:21.502927 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635be910-7b43-4a3b-b986-e04d64ec0cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:21.505330 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635be910-7b43-4a3b-b986-e04d64ec0cb3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:21.520286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 112/218] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:21.522196 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbba58-bc03-4148-b3f5-9304cec2ebff None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.522687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbba58-bc03-4148-b3f5-9304cec2ebff None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.523090 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbba58-bc03-4148-b3f5-9304cec2ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.545989 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 107/219] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:21.545989 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4af4d-12f6-4aa4-a8ce-fedd6abd6c46 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:21.552417 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bcdbba58-bc03-4148-b3f5-9304cec2ebff None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:21.554046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bcdbba58-bc03-4148-b3f5-9304cec2ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:21.662855 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 113/220] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:21.718962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4af4d-12f6-4aa4-a8ce-fedd6abd6c46 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:21.752980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:21.774709 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108a948-9379-49f1-b55f-f434f857fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:21.775751 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a948-9379-49f1-b55f-f434f857fe77 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.776230 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a948-9379-49f1-b55f-f434f857fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.776734 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108a948-9379-49f1-b55f-f434f857fe77 None admin] PATH_INFO: `/v3/users/d518f30e6b354235b0d4a243c5405c38` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.796000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108a948-9379-49f1-b55f-f434f857fe77 None admin] RBAC: Authorizing `identity:get_user(user_id=d518f30e6b354235b0d4a243c5405c38)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:21.798167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108a948-9379-49f1-b55f-f434f857fe77 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:21.800136 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 108/221] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:21 2022] GET /identity/v3/users/d518f30e6b354235b0d4a243c5405c38 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:21.805976 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbba58-bc03-4148-b3f5-9304cec2ebff None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:21.915840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:21.957599 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbba58-bc03-4148-b3f5-9304cec2ebff None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:21.968031 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108a948-9379-49f1-b55f-f434f857fe77 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:22.017345 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802636-82b1-45c6-8806-1484eb292a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:22.018399 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802636-82b1-45c6-8806-1484eb292a17 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:22.018905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802636-82b1-45c6-8806-1484eb292a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:22.019392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802636-82b1-45c6-8806-1484eb292a17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:22.112596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea802636-82b1-45c6-8806-1484eb292a17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:22.114201 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea802636-82b1-45c6-8806-1484eb292a17 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:22.137164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108a948-9379-49f1-b55f-f434f857fe77 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:22.177752 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679c2e-1015-48ae-a403-72bc57bcb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:22.178382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679c2e-1015-48ae-a403-72bc57bcb59a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:22.178663 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679c2e-1015-48ae-a403-72bc57bcb59a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:22.178933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679c2e-1015-48ae-a403-72bc57bcb59a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:22.189073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:22.195167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679c2e-1015-48ae-a403-72bc57bcb59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-5c679c2e-1015-48ae-a403-72bc57bcb59a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:22.202231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:22.203365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:22.204770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:22.206262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 109/222] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:22.207079 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679c2e-1015-48ae-a403-72bc57bcb59a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:22.264790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 114/223] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:22.273890 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802636-82b1-45c6-8806-1484eb292a17 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:22.274641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:22.389575 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679c2e-1015-48ae-a403-72bc57bcb59a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:22.449311 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802636-82b1-45c6-8806-1484eb292a17 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:22.461603 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727c1fc-08c2-4547-8561-93f7f89aa510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:22.463172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727c1fc-08c2-4547-8561-93f7f89aa510 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:22.463935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727c1fc-08c2-4547-8561-93f7f89aa510 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:22.464717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727c1fc-08c2-4547-8561-93f7f89aa510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:22.492423 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727c1fc-08c2-4547-8561-93f7f89aa510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:22.505485 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-3727c1fc-08c2-4547-8561-93f7f89aa510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:22.506061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:22.507905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:22.509691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:22.510989 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:22.510989 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:22.510989 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:22.511699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:22.512156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:22.513866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:22.514228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 110/224] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:22.523038 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727c1fc-08c2-4547-8561-93f7f89aa510 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:22.539559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 115/225] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:22.542383 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:22.589560 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:22.697216 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:22.702330 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727c1fc-08c2-4547-8561-93f7f89aa510 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:22.704364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da159aa-788c-4447-ad19-af87b906e29b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:22.749137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:22.750109 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:22.751263 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:22.751753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:22.752647 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:22.753458 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:22.755610 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:22.766647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ab36e-bd6d-4830-8b95-79d781bb16ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:22.767834 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab36e-bd6d-4830-8b95-79d781bb16ba None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:22.772489 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab36e-bd6d-4830-8b95-79d781bb16ba None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:22.772489 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab36e-bd6d-4830-8b95-79d781bb16ba None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:22.773085 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 116/226] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:22.773852 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ab36e-bd6d-4830-8b95-79d781bb16ba None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:22.774458 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:22.776223 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ab36e-bd6d-4830-8b95-79d781bb16ba None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:22.779583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 111/227] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:22 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:22.780931 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ab36e-bd6d-4830-8b95-79d781bb16ba None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:22.924263 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:22.934269 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6717f-37ce-49b7-aad4-d86b72870c13 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:22.962725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ab36e-bd6d-4830-8b95-79d781bb16ba None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:22.993440 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38279-298f-4a86-94ca-1e58e5c57bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:22.995166 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38279-298f-4a86-94ca-1e58e5c57bcd None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:22.996033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38279-298f-4a86-94ca-1e58e5c57bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:22.996553 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c38279-298f-4a86-94ca-1e58e5c57bcd None admin] PATH_INFO: `/v3/users/c0e587926f0b43b2b5921cca5ae52c49` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:22.999984 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c38279-298f-4a86-94ca-1e58e5c57bcd None admin] RBAC: Authorizing `identity:get_user(user_id=c0e587926f0b43b2b5921cca5ae52c49)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:23.004577 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c38279-298f-4a86-94ca-1e58e5c57bcd None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:23.007627 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 117/228] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:22 2022] GET /identity/v3/users/c0e587926f0b43b2b5921cca5ae52c49 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:23.008523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec27f3-70e3-4aa8-bfee-142a9b90cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:23.008998 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38279-298f-4a86-94ca-1e58e5c57bcd None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:23.009773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec27f3-70e3-4aa8-bfee-142a9b90cd32 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:23.010250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec27f3-70e3-4aa8-bfee-142a9b90cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:23.010711 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec27f3-70e3-4aa8-bfee-142a9b90cd32 None admin] PATH_INFO: `/v3/users/c0e587926f0b43b2b5921cca5ae52c49` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:23.012473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec27f3-70e3-4aa8-bfee-142a9b90cd32 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e587926f0b43b2b5921cca5ae52c49)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:23.014383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec27f3-70e3-4aa8-bfee-142a9b90cd32 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:23.016547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 112/229] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:22 2022] GET /identity/v3/users/c0e587926f0b43b2b5921cca5ae52c49 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:23.022198 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec27f3-70e3-4aa8-bfee-142a9b90cd32 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:23.084761 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:23.163774 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c38279-298f-4a86-94ca-1e58e5c57bcd None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:23.177385 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec27f3-70e3-4aa8-bfee-142a9b90cd32 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:23.205351 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:23.206411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:23.206883 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:23.207342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:23.208356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] RBAC: Adding query filter params (role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae, user.id=d518f30e6b354235b0d4a243c5405c38) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:23.209010 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:23.210654 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:23.216925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427dbd2-cd33-451f-b1a3-d1ffd4591969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:23.217664 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427dbd2-cd33-451f-b1a3-d1ffd4591969 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:23.218199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427dbd2-cd33-451f-b1a3-d1ffd4591969 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:23.218468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427dbd2-cd33-451f-b1a3-d1ffd4591969 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:23.225151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427dbd2-cd33-451f-b1a3-d1ffd4591969 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:23.225151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427dbd2-cd33-451f-b1a3-d1ffd4591969 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:23.225151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 113/231] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:23 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:23.225151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427dbd2-cd33-451f-b1a3-d1ffd4591969 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:23.225568 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 118/231] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:23 2022] GET /identity/v3/role_assignments?user.id=d518f30e6b354235b0d4a243c5405c38&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:23.237913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:23.276285 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:23.472135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbd4ee-d7a9-4785-aa83-eb97a52c029d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:23.496464 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427dbd2-cd33-451f-b1a3-d1ffd4591969 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:23.499441 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:23.521611 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fcbed-7fc5-410a-b1a8-e1c512a1fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:23.522585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fcbed-7fc5-410a-b1a8-e1c512a1fb4e None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:23.523037 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fcbed-7fc5-410a-b1a8-e1c512a1fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:23.523482 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fcbed-7fc5-410a-b1a8-e1c512a1fb4e None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/users/c0e587926f0b43b2b5921cca5ae52c49/roles/c4c1742a54eb440c9d94f137cb668187` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:23.525984 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fcbed-7fc5-410a-b1a8-e1c512a1fb4e None admin] RBAC: Authorizing `identity:create_grant(project_id=d6e695e9bbce46bfbf76400d173ba8ae, user_id=c0e587926f0b43b2b5921cca5ae52c49, role_id=c4c1742a54eb440c9d94f137cb668187)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:23.527667 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fcbed-7fc5-410a-b1a8-e1c512a1fb4e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:23.547967 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a785c-7c7e-4382-868a-f856ef3b3f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:23.547967 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a785c-7c7e-4382-868a-f856ef3b3f17 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:23.547967 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a785c-7c7e-4382-868a-f856ef3b3f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:23.547967 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a785c-7c7e-4382-868a-f856ef3b3f17 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:23.550709 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a785c-7c7e-4382-868a-f856ef3b3f17 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:23.555193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a785c-7c7e-4382-868a-f856ef3b3f17 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:23.557256 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 114/232] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:23 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:23.557649 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 119/233] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:23 2022] PUT /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/users/c0e587926f0b43b2b5921cca5ae52c49/roles/c4c1742a54eb440c9d94f137cb668187 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:23.566007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a785c-7c7e-4382-868a-f856ef3b3f17 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:23.695564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a785c-7c7e-4382-868a-f856ef3b3f17 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:23.744476 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c40bd-f3df-4acc-b1d8-4e89c6d1d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:23.745116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c40bd-f3df-4acc-b1d8-4e89c6d1d23c None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:23.745399 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c40bd-f3df-4acc-b1d8-4e89c6d1d23c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:23.745672 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c40bd-f3df-4acc-b1d8-4e89c6d1d23c None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/users/c0e587926f0b43b2b5921cca5ae52c49/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:23.748062 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c40bd-f3df-4acc-b1d8-4e89c6d1d23c None admin] RBAC: Authorizing `identity:create_grant(project_id=d6e695e9bbce46bfbf76400d173ba8ae, user_id=c0e587926f0b43b2b5921cca5ae52c49, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:23.749618 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c40bd-f3df-4acc-b1d8-4e89c6d1d23c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:23.783113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 115/234] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:23 2022] PUT /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/users/c0e587926f0b43b2b5921cca5ae52c49/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:24.239578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51add33-80fe-4415-a8da-2176eeae1ee0 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:24.239962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51add33-80fe-4415-a8da-2176eeae1ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:24.240135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51add33-80fe-4415-a8da-2176eeae1ee0 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:24.241597 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 120/235] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:24.247890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4da3e3-2e2b-4093-ba1d-9055d98798f8 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:24.248223 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4da3e3-2e2b-4093-ba1d-9055d98798f8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:24.248451 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4da3e3-2e2b-4093-ba1d-9055d98798f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:24.273694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-7a4da3e3-2e2b-4093-ba1d-9055d98798f8 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:24.274946 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-7a4da3e3-2e2b-4093-ba1d-9055d98798f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:24.314224 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:24.379108 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 116/236] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:24.527413 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91013-c233-4101-8882-26b33f5831a9 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:24.527905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91013-c233-4101-8882-26b33f5831a9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:24.528207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91013-c233-4101-8882-26b33f5831a9 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:24.529900 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 121/237] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:24.535444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a82ff-06cb-4432-a7a5-db2f9a7dac80 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:24.535937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a82ff-06cb-4432-a7a5-db2f9a7dac80 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:24.536013 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a82ff-06cb-4432-a7a5-db2f9a7dac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:24.559019 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3d5a82ff-06cb-4432-a7a5-db2f9a7dac80 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:24.560346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3d5a82ff-06cb-4432-a7a5-db2f9a7dac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:24.643348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 117/238] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:24.909779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91013-c233-4101-8882-26b33f5831a9 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:25.037546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:25.064789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91013-c233-4101-8882-26b33f5831a9 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:25.123882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23818a35-7cfc-49ec-a4c4-25d6e2e79c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:25.124995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818a35-7cfc-49ec-a4c4-25d6e2e79c51 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:25.125577 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818a35-7cfc-49ec-a4c4-25d6e2e79c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:25.126144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818a35-7cfc-49ec-a4c4-25d6e2e79c51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:25.145529 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23818a35-7cfc-49ec-a4c4-25d6e2e79c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-23818a35-7cfc-49ec-a4c4-25d6e2e79c51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:25.154459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:25.155408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:25.156223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:25.159108 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 122/239] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:25.163250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a82ff-06cb-4432-a7a5-db2f9a7dac80 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:25.257004 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23818a35-7cfc-49ec-a4c4-25d6e2e79c51 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:25.317049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:25.338647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a82ff-06cb-4432-a7a5-db2f9a7dac80 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:25.428376 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:25.428933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:25.429212 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:25.429484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:25.430158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:25.430459 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:25.432106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:25.450180 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 118/240] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:25.453174 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23818a35-7cfc-49ec-a4c4-25d6e2e79c51 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:25.456103 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:25.533420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c396552-12a1-4cf2-ac6e-a2a783120ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:25.534086 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c396552-12a1-4cf2-ac6e-a2a783120ae4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:25.534339 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c396552-12a1-4cf2-ac6e-a2a783120ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:25.534613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c396552-12a1-4cf2-ac6e-a2a783120ae4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:25.541501 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c396552-12a1-4cf2-ac6e-a2a783120ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:25.543002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c396552-12a1-4cf2-ac6e-a2a783120ae4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:25.544868 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 123/241] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:52:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:25.550661 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c396552-12a1-4cf2-ac6e-a2a783120ae4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:25.590093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:25.614172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566d18b-1553-45f7-9a3f-9cd1f0545e44 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:25.661307 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67ab1c-27be-4317-9d61-6cceefe6da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:25.661952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67ab1c-27be-4317-9d61-6cceefe6da43 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:25.662228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67ab1c-27be-4317-9d61-6cceefe6da43 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:25.662495 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67ab1c-27be-4317-9d61-6cceefe6da43 None admin] PATH_INFO: `/v3/users/8577dba71351447e85d918f92a4c962f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:25.689624 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67ab1c-27be-4317-9d61-6cceefe6da43 None admin] RBAC: Authorizing `identity:get_user(user_id=8577dba71351447e85d918f92a4c962f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:25.691028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67ab1c-27be-4317-9d61-6cceefe6da43 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:25.692939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 119/242] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:25 2022] GET /identity/v3/users/8577dba71351447e85d918f92a4c962f => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:25.698634 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67ab1c-27be-4317-9d61-6cceefe6da43 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:25.718708 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:25.788512 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c396552-12a1-4cf2-ac6e-a2a783120ae4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:25.858475 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac4c1b-248e-4af1-839b-96c098477b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:25.859831 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac4c1b-248e-4af1-839b-96c098477b3a None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:25.860829 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac4c1b-248e-4af1-839b-96c098477b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:25.861181 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac4c1b-248e-4af1-839b-96c098477b3a None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:25.861855 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac4c1b-248e-4af1-839b-96c098477b3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:25.863488 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac4c1b-248e-4af1-839b-96c098477b3a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:25.897915 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67ab1c-27be-4317-9d61-6cceefe6da43 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:25.922995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 124/243] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:52:25 2022] POST /identity/v3/users => generated 293 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:52:25.958394 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ba9d7-750f-4bae-81f6-effe5b4b8069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:25.959077 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ba9d7-750f-4bae-81f6-effe5b4b8069 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:25.959370 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ba9d7-750f-4bae-81f6-effe5b4b8069 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:25.959810 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ba9d7-750f-4bae-81f6-effe5b4b8069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.060386 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ba9d7-750f-4bae-81f6-effe5b4b8069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:26.062261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ba9d7-750f-4bae-81f6-effe5b4b8069 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:26.080195 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:26.219084 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 120/244] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:26.224451 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac4c1b-248e-4af1-839b-96c098477b3a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:26.293584 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6139e-be61-433b-b9d3-a040613c3aa4 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.294256 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6139e-be61-433b-b9d3-a040613c3aa4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.294740 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6139e-be61-433b-b9d3-a040613c3aa4 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.296816 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 121/245] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:26.304578 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc06b35-dfa4-4061-afd5-7ef65e56324c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.305241 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc06b35-dfa4-4061-afd5-7ef65e56324c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.305725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc06b35-dfa4-4061-afd5-7ef65e56324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.327999 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9cc06b35-dfa4-4061-afd5-7ef65e56324c None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:26.330449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9cc06b35-dfa4-4061-afd5-7ef65e56324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:26.380445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:26.454537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac4c1b-248e-4af1-839b-96c098477b3a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:26.486622 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 122/246] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:26.506924 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812862fa-c380-4d7e-af57-b045fecd444d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.507844 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812862fa-c380-4d7e-af57-b045fecd444d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.508613 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812862fa-c380-4d7e-af57-b045fecd444d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.511759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 123/247] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:26.518995 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633aa4-c8e4-4cd7-bf86-38886f7b6688 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.519900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633aa4-c8e4-4cd7-bf86-38886f7b6688 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.520793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633aa4-c8e4-4cd7-bf86-38886f7b6688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.524295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba530-a194-4d34-9ceb-a8e10e3f2e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:26.524977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba530-a194-4d34-9ceb-a8e10e3f2e8e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.525255 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba530-a194-4d34-9ceb-a8e10e3f2e8e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.525531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba530-a194-4d34-9ceb-a8e10e3f2e8e None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.527091 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceba530-a194-4d34-9ceb-a8e10e3f2e8e None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:26.528765 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceba530-a194-4d34-9ceb-a8e10e3f2e8e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:26.530954 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 125/248] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:26 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:26.541159 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba530-a194-4d34-9ceb-a8e10e3f2e8e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:26.551759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-45633aa4-c8e4-4cd7-bf86-38886f7b6688 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:26.551759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-45633aa4-c8e4-4cd7-bf86-38886f7b6688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:26.602314 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:26.658422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 124/249] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:26.746866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba530-a194-4d34-9ceb-a8e10e3f2e8e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:26.801621 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4586d7-a619-457a-953b-51e3892b15bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:26.802314 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4586d7-a619-457a-953b-51e3892b15bc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.802628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4586d7-a619-457a-953b-51e3892b15bc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.803115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4586d7-a619-457a-953b-51e3892b15bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.803966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4586d7-a619-457a-953b-51e3892b15bc None admin] RBAC: Adding query filter params (role.id=08de461272ef44ab9862da985703cb23, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae, user.id=8577dba71351447e85d918f92a4c962f) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:26.804375 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4586d7-a619-457a-953b-51e3892b15bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:26.806205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4586d7-a619-457a-953b-51e3892b15bc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:26.814113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 126/250] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:26 2022] GET /identity/v3/role_assignments?user.id=8577dba71351447e85d918f92a4c962f&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=08de461272ef44ab9862da985703cb23 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:26.914095 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45633aa4-c8e4-4cd7-bf86-38886f7b6688 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:27.058143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45633aa4-c8e4-4cd7-bf86-38886f7b6688 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:27.107346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04966a21-7a77-4b16-9e28-e01efe1feb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:27.108580 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04966a21-7a77-4b16-9e28-e01efe1feb93 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:27.109387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04966a21-7a77-4b16-9e28-e01efe1feb93 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:27.110722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04966a21-7a77-4b16-9e28-e01efe1feb93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:27.116687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310904-0808-49fb-b879-1fd0d9cdd3df None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:27.116687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310904-0808-49fb-b879-1fd0d9cdd3df None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:27.116687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310904-0808-49fb-b879-1fd0d9cdd3df None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:27.117748 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 127/251] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:27.123393 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd070976-62ad-405c-ba39-0f2da8f0ecc0 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:27.124026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd070976-62ad-405c-ba39-0f2da8f0ecc0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:27.124514 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd070976-62ad-405c-ba39-0f2da8f0ecc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:27.139163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:27.154013 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04966a21-7a77-4b16-9e28-e01efe1feb93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-04966a21-7a77-4b16-9e28-e01efe1feb93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:27.164642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:27.165677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:27.166536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:27.167201 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 125/252] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:27.168996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bd070976-62ad-405c-ba39-0f2da8f0ecc0 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:27.170489 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bd070976-62ad-405c-ba39-0f2da8f0ecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:27.178842 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04966a21-7a77-4b16-9e28-e01efe1feb93 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:27.263002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:27.268491 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 128/253] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:27.269498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd070976-62ad-405c-ba39-0f2da8f0ecc0 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:27.398420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd070976-62ad-405c-ba39-0f2da8f0ecc0 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:27.415089 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04966a21-7a77-4b16-9e28-e01efe1feb93 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:27.436869 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:27.443519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae219b-b99d-475f-8b7e-67f2ad7b5e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:27.444704 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae219b-b99d-475f-8b7e-67f2ad7b5e87 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:27.445145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae219b-b99d-475f-8b7e-67f2ad7b5e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:27.446171 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae219b-b99d-475f-8b7e-67f2ad7b5e87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:27.460613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae219b-b99d-475f-8b7e-67f2ad7b5e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-3fae219b-b99d-475f-8b7e-67f2ad7b5e87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:27.465913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:27.467039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:27.468170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:27.471083 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 129/254] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:27.481244 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae219b-b99d-475f-8b7e-67f2ad7b5e87 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:27.512679 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:27.517656 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:27.518115 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:27.518542 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:27.519524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:27.520085 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:27.525893 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:27.545962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 126/255] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:27.553147 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:27.616823 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae219b-b99d-475f-8b7e-67f2ad7b5e87 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:27.721673 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:27.722641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:27.723127 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:27.728685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:27.730144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:27.730640 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:27.737178 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:27.772464 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 130/256] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:27.803811 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:27.900492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:27.934892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82e5e-fc71-4509-9b99-1f5c4a26e18b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:27.951959 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:28.021467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b754b44-4b16-4e0f-b74c-6f75f63b1e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:28.022475 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b754b44-4b16-4e0f-b74c-6f75f63b1e6c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:28.022970 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b754b44-4b16-4e0f-b74c-6f75f63b1e6c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:28.023467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b754b44-4b16-4e0f-b74c-6f75f63b1e6c None admin] PATH_INFO: `/v3/users/d518f30e6b354235b0d4a243c5405c38` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:28.029970 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b754b44-4b16-4e0f-b74c-6f75f63b1e6c None admin] RBAC: Authorizing `identity:get_user(user_id=d518f30e6b354235b0d4a243c5405c38)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:28.032856 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b754b44-4b16-4e0f-b74c-6f75f63b1e6c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:28.036468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 127/257] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:27 2022] GET /identity/v3/users/d518f30e6b354235b0d4a243c5405c38 => generated 297 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:28.044808 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b754b44-4b16-4e0f-b74c-6f75f63b1e6c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:28.070937 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9147f-a247-475e-94d0-96e204f278a3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:28.151133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b702a-0749-40fc-9a00-62fa8a668298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:28.151826 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b702a-0749-40fc-9a00-62fa8a668298 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:28.152180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b702a-0749-40fc-9a00-62fa8a668298 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:28.152526 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b702a-0749-40fc-9a00-62fa8a668298 None admin] PATH_INFO: `/v3/users/c0e587926f0b43b2b5921cca5ae52c49` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:28.154333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b702a-0749-40fc-9a00-62fa8a668298 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e587926f0b43b2b5921cca5ae52c49)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:28.157021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b702a-0749-40fc-9a00-62fa8a668298 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:28.159991 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 131/258] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:27 2022] GET /identity/v3/users/c0e587926f0b43b2b5921cca5ae52c49 => generated 283 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:28.161532 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b702a-0749-40fc-9a00-62fa8a668298 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:28.255556 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b754b44-4b16-4e0f-b74c-6f75f63b1e6c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:28.304564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e86aac-883e-4869-912f-024931d541f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:28.305583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86aac-883e-4869-912f-024931d541f6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:28.306182 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86aac-883e-4869-912f-024931d541f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:28.306683 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e86aac-883e-4869-912f-024931d541f6 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:28.308194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e86aac-883e-4869-912f-024931d541f6 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:28.310515 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e86aac-883e-4869-912f-024931d541f6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:28.313126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 128/259] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:28 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:28.314248 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e86aac-883e-4869-912f-024931d541f6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:28.354753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:28.391672 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b702a-0749-40fc-9a00-62fa8a668298 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:28.428410 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:28.456801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f705-1dd3-4693-b54d-7204bd05727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:28.457739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f705-1dd3-4693-b54d-7204bd05727f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:28.458177 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f705-1dd3-4693-b54d-7204bd05727f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:28.458616 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f705-1dd3-4693-b54d-7204bd05727f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:28.481545 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f705-1dd3-4693-b54d-7204bd05727f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-30b7f705-1dd3-4693-b54d-7204bd05727f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:28.488093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:28.489111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:28.489953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 132/260] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:28.491163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f705-1dd3-4693-b54d-7204bd05727f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:28.519063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e86aac-883e-4869-912f-024931d541f6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:28.597781 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be72e23-18b9-457e-897d-e5713fc4bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:28.599352 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be72e23-18b9-457e-897d-e5713fc4bc33 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:28.602825 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be72e23-18b9-457e-897d-e5713fc4bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:28.603680 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be72e23-18b9-457e-897d-e5713fc4bc33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:28.731514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be72e23-18b9-457e-897d-e5713fc4bc33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:28.733500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be72e23-18b9-457e-897d-e5713fc4bc33 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:28.743437 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f705-1dd3-4693-b54d-7204bd05727f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:28.764564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:28.847982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 129/261] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:28.848924 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be72e23-18b9-457e-897d-e5713fc4bc33 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:28.878047 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4865c-c19b-4c18-860c-1f3bf0e860eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:28.878735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4865c-c19b-4c18-860c-1f3bf0e860eb None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:28.879019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4865c-c19b-4c18-860c-1f3bf0e860eb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:28.879298 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4865c-c19b-4c18-860c-1f3bf0e860eb None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/users/d518f30e6b354235b0d4a243c5405c38/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:28.881335 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4865c-c19b-4c18-860c-1f3bf0e860eb None admin] RBAC: Authorizing `identity:create_grant(project_id=d6e695e9bbce46bfbf76400d173ba8ae, user_id=d518f30e6b354235b0d4a243c5405c38, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:28.882822 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4865c-c19b-4c18-860c-1f3bf0e860eb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:28.916038 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 133/262] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:28 2022] PUT /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/users/d518f30e6b354235b0d4a243c5405c38/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:28.921628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4865c-c19b-4c18-860c-1f3bf0e860eb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:29.039983 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be72e23-18b9-457e-897d-e5713fc4bc33 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:29.054241 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:29.082011 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:29.098670 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:29.099276 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.099572 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.099846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.100631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:29.100995 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:29.102596 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:29.123862 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 130/263] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:29.130594 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:29.246814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4865c-c19b-4c18-860c-1f3bf0e860eb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:29.320288 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe11451-125c-4148-9eeb-c6609efa5283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:29.321255 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe11451-125c-4148-9eeb-c6609efa5283 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.321719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe11451-125c-4148-9eeb-c6609efa5283 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.322059 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe11451-125c-4148-9eeb-c6609efa5283 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.323623 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe11451-125c-4148-9eeb-c6609efa5283 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:29.325341 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe11451-125c-4148-9eeb-c6609efa5283 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:29.327866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 134/264] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:28 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:29.335545 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe11451-125c-4148-9eeb-c6609efa5283 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:29.375837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2dcad-6991-4f9e-925c-c05fe15aa185 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:29.451244 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6d219-24dd-45bd-8c54-e9e84d870f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:29.451893 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d219-24dd-45bd-8c54-e9e84d870f0b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.452173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d219-24dd-45bd-8c54-e9e84d870f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.452446 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d219-24dd-45bd-8c54-e9e84d870f0b None admin] PATH_INFO: `/v3/users/c0e587926f0b43b2b5921cca5ae52c49` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.453853 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6d219-24dd-45bd-8c54-e9e84d870f0b None admin] RBAC: Authorizing `identity:get_user(user_id=c0e587926f0b43b2b5921cca5ae52c49)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:29.455331 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6d219-24dd-45bd-8c54-e9e84d870f0b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:29.457233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 131/265] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:29 2022] GET /identity/v3/users/c0e587926f0b43b2b5921cca5ae52c49 => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:29.463519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6d219-24dd-45bd-8c54-e9e84d870f0b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:29.548769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe11451-125c-4148-9eeb-c6609efa5283 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:29.573039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:29.596261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:29.629282 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc343a7f-afc5-42cd-bb13-3a7e8982ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:29.629813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343a7f-afc5-42cd-bb13-3a7e8982ee18 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.630092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343a7f-afc5-42cd-bb13-3a7e8982ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.630360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343a7f-afc5-42cd-bb13-3a7e8982ee18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.631099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc343a7f-afc5-42cd-bb13-3a7e8982ee18 None admin] RBAC: Adding query filter params (role.id=c4c1742a54eb440c9d94f137cb668187, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae, user.id=c0e587926f0b43b2b5921cca5ae52c49) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:29.631407 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc343a7f-afc5-42cd-bb13-3a7e8982ee18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:29.632910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc343a7f-afc5-42cd-bb13-3a7e8982ee18 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:29.647691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 135/266] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:29 2022] GET /identity/v3/role_assignments?user.id=c0e587926f0b43b2b5921cca5ae52c49&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=c4c1742a54eb440c9d94f137cb668187 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:29.669548 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6d219-24dd-45bd-8c54-e9e84d870f0b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:29.707587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6415-d534-402c-b0e7-3c4a542ada95 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.707892 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6415-d534-402c-b0e7-3c4a542ada95 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.708139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d6415-d534-402c-b0e7-3c4a542ada95 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.709752 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 136/267] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:29.714166 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0000040-1a39-48a4-99dc-be6ce6f99db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:29.714807 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0000040-1a39-48a4-99dc-be6ce6f99db7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.715086 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0000040-1a39-48a4-99dc-be6ce6f99db7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.715358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0000040-1a39-48a4-99dc-be6ce6f99db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.719704 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249e1b-baa5-40ca-82fd-592ac983a3ac None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.720036 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249e1b-baa5-40ca-82fd-592ac983a3ac None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.720248 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249e1b-baa5-40ca-82fd-592ac983a3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.753526 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-70249e1b-baa5-40ca-82fd-592ac983a3ac None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:29.754796 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-70249e1b-baa5-40ca-82fd-592ac983a3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:29.879119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0000040-1a39-48a4-99dc-be6ce6f99db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:29.881662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0000040-1a39-48a4-99dc-be6ce6f99db7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:29.916840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 137/268] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:29.977637 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:30.032188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 132/269] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:30.033907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70249e1b-baa5-40ca-82fd-592ac983a3ac None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:30.073109 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81065023-4fb1-406f-bafb-90cdb1328201 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.073637 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81065023-4fb1-406f-bafb-90cdb1328201 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.073637 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81065023-4fb1-406f-bafb-90cdb1328201 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.075333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 133/270] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:30.093854 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b7346-568f-47fd-aef9-55d32c03e327 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.094233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b7346-568f-47fd-aef9-55d32c03e327 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.094455 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b7346-568f-47fd-aef9-55d32c03e327 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.095991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 134/271] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:30.097021 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a6d2a-d186-467b-9930-d6ce3a8419dd None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.097304 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a6d2a-d186-467b-9930-d6ce3a8419dd None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.097576 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a6d2a-d186-467b-9930-d6ce3a8419dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.136018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c57a6d2a-d186-467b-9930-d6ce3a8419dd None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:30.139387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c57a6d2a-d186-467b-9930-d6ce3a8419dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:30.182923 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70249e1b-baa5-40ca-82fd-592ac983a3ac None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:30.187191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:30.239717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5e48-9da6-4a6e-83d5-e5ce57ae91e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:30.240412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5e48-9da6-4a6e-83d5-e5ce57ae91e6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.240765 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5e48-9da6-4a6e-83d5-e5ce57ae91e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.241044 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5e48-9da6-4a6e-83d5-e5ce57ae91e6 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.242273 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c5e48-9da6-4a6e-83d5-e5ce57ae91e6 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:30.243873 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c5e48-9da6-4a6e-83d5-e5ce57ae91e6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:30.245780 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 138/272] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:30 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:30.247003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd4da-cfd8-4c1d-ab96-7cfd7b327a74 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.247249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd4da-cfd8-4c1d-ab96-7cfd7b327a74 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.247526 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd4da-cfd8-4c1d-ab96-7cfd7b327a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.257212 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 135/273] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:30.258568 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a6d2a-d186-467b-9930-d6ce3a8419dd None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:30.269391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b5ecd4da-cfd8-4c1d-ab96-7cfd7b327a74 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:30.270601 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b5ecd4da-cfd8-4c1d-ab96-7cfd7b327a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:30.369067 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 139/274] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:30.387405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd4da-cfd8-4c1d-ab96-7cfd7b327a74 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:30.399842 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:30.435884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a6d2a-d186-467b-9930-d6ce3a8419dd None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:30.504259 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:30.504979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.505269 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.505544 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.506355 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae, user.id=c0e587926f0b43b2b5921cca5ae52c49) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:30.506674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:30.508154 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:30.520919 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 136/275] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:30 2022] GET /identity/v3/role_assignments?user.id=c0e587926f0b43b2b5921cca5ae52c49&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:30.578700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd4da-cfd8-4c1d-ab96-7cfd7b327a74 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:30.580542 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:30.632197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67731202-d36f-49d3-8afd-9c6b11ae008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:30.632882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731202-d36f-49d3-8afd-9c6b11ae008a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.633167 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731202-d36f-49d3-8afd-9c6b11ae008a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.633605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731202-d36f-49d3-8afd-9c6b11ae008a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.656081 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67731202-d36f-49d3-8afd-9c6b11ae008a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-67731202-d36f-49d3-8afd-9c6b11ae008a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:30.662604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:30.663555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:30.664364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:30.665006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 140/276] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:30.673862 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:30.767035 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67731202-d36f-49d3-8afd-9c6b11ae008a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:30.837023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e35f6-7d9a-4a13-b231-71c5ae21d102 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:30.876468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:30.877116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.877398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.877670 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.878732 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:30.878732 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:30.880007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:30.891029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 137/277] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:30.893421 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67731202-d36f-49d3-8afd-9c6b11ae008a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:30.897262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:30.921146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:30.936892 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06b8f-ce11-42ba-af2a-32bdae69386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:30.937537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06b8f-ce11-42ba-af2a-32bdae69386a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.937858 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06b8f-ce11-42ba-af2a-32bdae69386a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.938130 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06b8f-ce11-42ba-af2a-32bdae69386a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.953711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a06b8f-ce11-42ba-af2a-32bdae69386a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-d6a06b8f-ce11-42ba-af2a-32bdae69386a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:30.958499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:30.959533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:30.960444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:30.961160 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 141/278] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:30.961794 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06b8f-ce11-42ba-af2a-32bdae69386a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:30.997727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:31.029369 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07314-4036-457f-9781-43e6f636cca1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:31.064899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389bfb3-9337-4521-906c-c266b8fc1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:31.065527 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389bfb3-9337-4521-906c-c266b8fc1543 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.065804 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389bfb3-9337-4521-906c-c266b8fc1543 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.066072 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389bfb3-9337-4521-906c-c266b8fc1543 None admin] PATH_INFO: `/v3/users/15b7d5b2bc4540f5ab817fd0855949c9` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.079689 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06b8f-ce11-42ba-af2a-32bdae69386a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:31.082922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389bfb3-9337-4521-906c-c266b8fc1543 None admin] RBAC: Authorizing `identity:get_user(user_id=15b7d5b2bc4540f5ab817fd0855949c9)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:31.084912 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389bfb3-9337-4521-906c-c266b8fc1543 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:31.087046 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 138/279] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:30 2022] GET /identity/v3/users/15b7d5b2bc4540f5ab817fd0855949c9 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:31.088399 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389bfb3-9337-4521-906c-c266b8fc1543 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:31.117596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3708a3-1c00-41d2-ab2c-eeba3c80d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:31.118326 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3708a3-1c00-41d2-ab2c-eeba3c80d462 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.118691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3708a3-1c00-41d2-ab2c-eeba3c80d462 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.119033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3708a3-1c00-41d2-ab2c-eeba3c80d462 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.120205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3708a3-1c00-41d2-ab2c-eeba3c80d462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:31.121774 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3708a3-1c00-41d2-ab2c-eeba3c80d462 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:31.123392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 142/280] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:52:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:31.124175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3708a3-1c00-41d2-ab2c-eeba3c80d462 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:31.175991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:31.211333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389bfb3-9337-4521-906c-c266b8fc1543 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:31.218264 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:31.229515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3708a3-1c00-41d2-ab2c-eeba3c80d462 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:31.251083 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:31.251944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.252370 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.252821 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.253824 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:31.254134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:31.255524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:31.269411 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 139/281] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:31.269411 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:31.270828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:31.271461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.271737 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.272010 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.272775 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] RBAC: Adding query filter params (role.id=74f67ab31fb74494b29826e8e6fd77cc, user.id=15b7d5b2bc4540f5ab817fd0855949c9, scope.system=all) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:31.273087 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:31.274589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:31.280129 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 143/282] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 24 09:52:31 2022] GET /identity/v3/role_assignments?user.id=15b7d5b2bc4540f5ab817fd0855949c9&scope.system=all&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:31.282970 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:31.418623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940955a-3c35-42c1-9be0-a21a18929655 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:31.425151 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771dbd-aa62-4bd5-9a8f-c800814ba88a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:31.460718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fb56e-83af-4610-9c47-5302272484c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:31.461661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb56e-83af-4610-9c47-5302272484c9 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.462137 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb56e-83af-4610-9c47-5302272484c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.462642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb56e-83af-4610-9c47-5302272484c9 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.463502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fb56e-83af-4610-9c47-5302272484c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:31.465250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fb56e-83af-4610-9c47-5302272484c9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:31.474539 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4f1f7-2dfd-47c1-83ea-2a64d61240d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:31.475184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4f1f7-2dfd-47c1-83ea-2a64d61240d3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.475465 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4f1f7-2dfd-47c1-83ea-2a64d61240d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.475735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4f1f7-2dfd-47c1-83ea-2a64d61240d3 None admin] PATH_INFO: `/v3/users/8577dba71351447e85d918f92a4c962f` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.477540 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:31.478187 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4f1f7-2dfd-47c1-83ea-2a64d61240d3 None admin] RBAC: Authorizing `identity:get_user(user_id=8577dba71351447e85d918f92a4c962f)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:31.479782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4f1f7-2dfd-47c1-83ea-2a64d61240d3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:31.486713 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 144/283] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:31 2022] GET /identity/v3/users/8577dba71351447e85d918f92a4c962f => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:31.488950 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4f1f7-2dfd-47c1-83ea-2a64d61240d3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:31.505092 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 140/284] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:52:31 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:52:31.525111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:31.613416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4f1f7-2dfd-47c1-83ea-2a64d61240d3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:31.653374 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a5308-6c18-48e3-93b6-ad6bff54b305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:31.654020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5308-6c18-48e3-93b6-ad6bff54b305 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.654301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5308-6c18-48e3-93b6-ad6bff54b305 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.654576 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a5308-6c18-48e3-93b6-ad6bff54b305 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.655730 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a5308-6c18-48e3-93b6-ad6bff54b305 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:31.657301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a5308-6c18-48e3-93b6-ad6bff54b305 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:31.659338 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 145/285] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:31 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:31.665209 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fb56e-83af-4610-9c47-5302272484c9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:31.788108 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fb56e-83af-4610-9c47-5302272484c9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:31.830521 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d3663-00c9-4696-abcb-71a6a00d2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:31.831191 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3663-00c9-4696-abcb-71a6a00d2c77 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.831471 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3663-00c9-4696-abcb-71a6a00d2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.831745 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d3663-00c9-4696-abcb-71a6a00d2c77 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/users/8577dba71351447e85d918f92a4c962f/roles/08de461272ef44ab9862da985703cb23` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.833829 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d3663-00c9-4696-abcb-71a6a00d2c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6e695e9bbce46bfbf76400d173ba8ae, user_id=8577dba71351447e85d918f92a4c962f, role_id=08de461272ef44ab9862da985703cb23)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:31.835273 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d3663-00c9-4696-abcb-71a6a00d2c77 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:31.857591 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 141/286] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:52:31 2022] PUT /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/users/8577dba71351447e85d918f92a4c962f/roles/08de461272ef44ab9862da985703cb23 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:52:31.949232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ce9d-0da3-4cda-be2f-f0d614dddc0a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.949977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ce9d-0da3-4cda-be2f-f0d614dddc0a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.949977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ce9d-0da3-4cda-be2f-f0d614dddc0a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.951119 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 146/287] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:31.957290 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf406-1ee7-484d-8a6e-45bef31b42e8 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:31.957574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf406-1ee7-484d-8a6e-45bef31b42e8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:31.957873 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf406-1ee7-484d-8a6e-45bef31b42e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:31.979144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-21bdf406-1ee7-484d-8a6e-45bef31b42e8 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:31.980415 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-21bdf406-1ee7-484d-8a6e-45bef31b42e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:32.040924 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:32.068459 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 142/288] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:32.450815 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5ce9d-0da3-4cda-be2f-f0d614dddc0a None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:32.621026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:32.630840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5ce9d-0da3-4cda-be2f-f0d614dddc0a None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:32.668232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8010-ed77-4d55-9010-544775c93639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:32.668899 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8010-ed77-4d55-9010-544775c93639 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:32.669181 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8010-ed77-4d55-9010-544775c93639 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:32.669448 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8010-ed77-4d55-9010-544775c93639 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:32.682684 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a8010-ed77-4d55-9010-544775c93639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-7b7a8010-ed77-4d55-9010-544775c93639 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:32.687483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:32.688445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:32.689303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 147/289] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:32.694421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf406-1ee7-484d-8a6e-45bef31b42e8 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:32.861168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf406-1ee7-484d-8a6e-45bef31b42e8 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:32.918116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:32.918578 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:32.918860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:32.919131 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:32.919809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:32.920112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:32.921535 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:32.936066 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 143/290] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:32.941928 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8010-ed77-4d55-9010-544775c93639 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:33.137182 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8010-ed77-4d55-9010-544775c93639 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:33.213819 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4b0e7-baa1-46cf-af51-4a5762e0a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:33.214543 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b0e7-baa1-46cf-af51-4a5762e0a392 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:33.215175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b0e7-baa1-46cf-af51-4a5762e0a392 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:33.215575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4b0e7-baa1-46cf-af51-4a5762e0a392 None admin] PATH_INFO: `/v3/users/d518f30e6b354235b0d4a243c5405c38` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:33.216891 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4b0e7-baa1-46cf-af51-4a5762e0a392 None admin] RBAC: Authorizing `identity:get_user(user_id=d518f30e6b354235b0d4a243c5405c38)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:33.219005 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4b0e7-baa1-46cf-af51-4a5762e0a392 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:33.220923 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 148/291] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:32 2022] GET /identity/v3/users/d518f30e6b354235b0d4a243c5405c38 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:33.226406 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:33.285707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:33.367277 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88cb1a-2de3-44bb-8d66-7c5a290e2dba None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:33.410902 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56f8a3-0173-49d2-8e41-47723bc7e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:33.411429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f8a3-0173-49d2-8e41-47723bc7e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:33.411712 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f8a3-0173-49d2-8e41-47723bc7e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:33.411989 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f8a3-0173-49d2-8e41-47723bc7e4e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:33.504143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56f8a3-0173-49d2-8e41-47723bc7e4e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:33.505642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56f8a3-0173-49d2-8e41-47723bc7e4e7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:33.561474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:33.641254 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 144/292] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:52:33.646870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4b0e7-baa1-46cf-af51-4a5762e0a392 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:33.672876 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:33.772974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4b0e7-baa1-46cf-af51-4a5762e0a392 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:33.811629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd57c7a-1547-40c7-a46a-e704b7c05e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:33.812290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57c7a-1547-40c7-a46a-e704b7c05e51 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:33.812608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57c7a-1547-40c7-a46a-e704b7c05e51 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:33.812917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57c7a-1547-40c7-a46a-e704b7c05e51 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:33.814101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd57c7a-1547-40c7-a46a-e704b7c05e51 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:33.815564 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd57c7a-1547-40c7-a46a-e704b7c05e51 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:33.817560 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 149/293] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:33 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:33.825844 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56f8a3-0173-49d2-8e41-47723bc7e4e7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:33.829409 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883af7-0101-4291-9672-27d539f3576b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:33.829696 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883af7-0101-4291-9672-27d539f3576b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:33.829976 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883af7-0101-4291-9672-27d539f3576b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:33.831368 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 150/294] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:33.841629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec81ac-867f-439a-9cee-3a10c31f9735 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:33.841918 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec81ac-867f-439a-9cee-3a10c31f9735 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:33.842199 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec81ac-867f-439a-9cee-3a10c31f9735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:33.876922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-35ec81ac-867f-439a-9cee-3a10c31f9735 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:33.879367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-35ec81ac-867f-439a-9cee-3a10c31f9735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:33.999949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 151/295] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:34.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56f8a3-0173-49d2-8e41-47723bc7e4e7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:34.062419 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af45e9-a9a6-4ecc-9c89-8ddec8cd6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:34.063076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af45e9-a9a6-4ecc-9c89-8ddec8cd6d6b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.063358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af45e9-a9a6-4ecc-9c89-8ddec8cd6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.063633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af45e9-a9a6-4ecc-9c89-8ddec8cd6d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.064358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af45e9-a9a6-4ecc-9c89-8ddec8cd6d6b None admin] RBAC: Adding query filter params (role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae, user.id=d518f30e6b354235b0d4a243c5405c38) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:34.064682 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af45e9-a9a6-4ecc-9c89-8ddec8cd6d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:34.066112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af45e9-a9a6-4ecc-9c89-8ddec8cd6d6b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:34.077438 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 145/296] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:33 2022] GET /identity/v3/role_assignments?user.id=d518f30e6b354235b0d4a243c5405c38&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:34.433071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec81ac-867f-439a-9cee-3a10c31f9735 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:34.452931 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:34.545231 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec81ac-867f-439a-9cee-3a10c31f9735 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:34.552713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fbf37-0f16-4a74-a892-3a8ea67ac25a None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.553006 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fbf37-0f16-4a74-a892-3a8ea67ac25a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.553288 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fbf37-0f16-4a74-a892-3a8ea67ac25a None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.555070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 146/297] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:34.560435 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d537c-258b-40ee-b961-769ad2310e97 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.560745 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d537c-258b-40ee-b961-769ad2310e97 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.561028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d537c-258b-40ee-b961-769ad2310e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.581045 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:34.589011 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-019d537c-258b-40ee-b961-769ad2310e97 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:34.590236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-019d537c-258b-40ee-b961-769ad2310e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:34.600271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da1318-6a15-4757-b55f-cb799f5a04f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:34.601004 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da1318-6a15-4757-b55f-cb799f5a04f7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.601326 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da1318-6a15-4757-b55f-cb799f5a04f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.601600 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da1318-6a15-4757-b55f-cb799f5a04f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.616818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da1318-6a15-4757-b55f-cb799f5a04f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-09da1318-6a15-4757-b55f-cb799f5a04f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:34.624217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:34.625727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:34.626559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 152/298] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:34.630504 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21806a-6909-4883-b978-7f99d5b4e3e0 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.630789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21806a-6909-4883-b978-7f99d5b4e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.631064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21806a-6909-4883-b978-7f99d5b4e3e0 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.632766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 153/299] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:34.634585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21806a-6909-4883-b978-7f99d5b4e3e0 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:34.671391 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 147/300] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:34.679085 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf6d47-fee6-4915-be9c-f6745a2864aa None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.679491 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf6d47-fee6-4915-be9c-f6745a2864aa None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.679861 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf6d47-fee6-4915-be9c-f6745a2864aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.705796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-69bf6d47-fee6-4915-be9c-f6745a2864aa None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:34.707694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-69bf6d47-fee6-4915-be9c-f6745a2864aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:34.724590 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:34.752525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21806a-6909-4883-b978-7f99d5b4e3e0 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:34.795047 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fe971-b044-4a81-917c-138901286206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:34.795798 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fe971-b044-4a81-917c-138901286206 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.796140 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fe971-b044-4a81-917c-138901286206 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.796476 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fe971-b044-4a81-917c-138901286206 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.797290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fe971-b044-4a81-917c-138901286206 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:34.797653 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fe971-b044-4a81-917c-138901286206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:34.799100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fe971-b044-4a81-917c-138901286206 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:34.802437 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 148/301] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:34.808138 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 154/302] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:34.814802 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf6d47-fee6-4915-be9c-f6745a2864aa None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:34.889534 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:34.930765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf6d47-fee6-4915-be9c-f6745a2864aa None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:34.973571 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ca0b-d8fe-4a80-a4b9-61f958643705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:34.974119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ca0b-d8fe-4a80-a4b9-61f958643705 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.974452 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ca0b-d8fe-4a80-a4b9-61f958643705 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.974730 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ca0b-d8fe-4a80-a4b9-61f958643705 None admin] PATH_INFO: `/v3/users/15b7d5b2bc4540f5ab817fd0855949c9` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.975981 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029ca0b-d8fe-4a80-a4b9-61f958643705 None admin] RBAC: Authorizing `identity:get_user(user_id=15b7d5b2bc4540f5ab817fd0855949c9)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:34.977546 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029ca0b-d8fe-4a80-a4b9-61f958643705 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:34.979490 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 149/303] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:34 2022] GET /identity/v3/users/15b7d5b2bc4540f5ab817fd0855949c9 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:34.988124 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fe971-b044-4a81-917c-138901286206 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.053258 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ca0b-d8fe-4a80-a4b9-61f958643705 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.116029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fe971-b044-4a81-917c-138901286206 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:35.155450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a3b5d-555f-4421-b05c-7664a79b26e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:35.156136 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3b5d-555f-4421-b05c-7664a79b26e7 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.156451 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3b5d-555f-4421-b05c-7664a79b26e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.156754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a3b5d-555f-4421-b05c-7664a79b26e7 None admin] PATH_INFO: `/v3/system/users/15b7d5b2bc4540f5ab817fd0855949c9/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.158294 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a3b5d-555f-4421-b05c-7664a79b26e7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=15b7d5b2bc4540f5ab817fd0855949c9, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:35.159696 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a3b5d-555f-4421-b05c-7664a79b26e7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:35.168293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 155/304] 10.222.0.70 () {58 vars in 1334 bytes} [Wed Aug 24 09:52:34 2022] PUT /identity/v3/system/users/15b7d5b2bc4540f5ab817fd0855949c9/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:35.169868 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac03c-f0eb-4ce8-9686-3769682b58ed None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.170161 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac03c-f0eb-4ce8-9686-3769682b58ed None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.170437 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ac03c-f0eb-4ce8-9686-3769682b58ed None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.171687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 156/305] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:35.173041 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ac03c-f0eb-4ce8-9686-3769682b58ed None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.178720 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ca0b-d8fe-4a80-a4b9-61f958643705 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:35.179414 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:35.219264 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd21260-2d9e-497a-aa4e-c3f38d325bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:35.219907 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd21260-2d9e-497a-aa4e-c3f38d325bc0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.220188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd21260-2d9e-497a-aa4e-c3f38d325bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.220461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd21260-2d9e-497a-aa4e-c3f38d325bc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.221627 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd21260-2d9e-497a-aa4e-c3f38d325bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:35.223935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd21260-2d9e-497a-aa4e-c3f38d325bc0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:35.225053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 150/306] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:52:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:35.226207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774b56-8c4c-4bbd-bd95-ff3f703367c6 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.226497 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774b56-8c4c-4bbd-bd95-ff3f703367c6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.226770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774b56-8c4c-4bbd-bd95-ff3f703367c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.234297 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:35.248814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-db774b56-8c4c-4bbd-bd95-ff3f703367c6 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:35.250982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-db774b56-8c4c-4bbd-bd95-ff3f703367c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:35.306570 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ac03c-f0eb-4ce8-9686-3769682b58ed None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:35.340106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 151/307] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:35.341034 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774b56-8c4c-4bbd-bd95-ff3f703367c6 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.353574 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05107016-f4c2-4f69-b9bb-e45e1dd88b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:35.354570 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107016-f4c2-4f69-b9bb-e45e1dd88b6c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.355048 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107016-f4c2-4f69-b9bb-e45e1dd88b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.355514 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107016-f4c2-4f69-b9bb-e45e1dd88b6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.373981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05107016-f4c2-4f69-b9bb-e45e1dd88b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-05107016-f4c2-4f69-b9bb-e45e1dd88b6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:35.381747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:35.382856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:35.383741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:35.386002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 157/308] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:35.393175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05107016-f4c2-4f69-b9bb-e45e1dd88b6c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.470458 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774b56-8c4c-4bbd-bd95-ff3f703367c6 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:35.472707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:35.506469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:35.513708 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687165e0-8e85-4c98-a8e2-87f88a1f41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:35.514943 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687165e0-8e85-4c98-a8e2-87f88a1f41ce None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.515385 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687165e0-8e85-4c98-a8e2-87f88a1f41ce None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.515904 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687165e0-8e85-4c98-a8e2-87f88a1f41ce None admin] PATH_INFO: `/v3/groups` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.516851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687165e0-8e85-4c98-a8e2-87f88a1f41ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:35.518840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687165e0-8e85-4c98-a8e2-87f88a1f41ce None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:35.528475 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05107016-f4c2-4f69-b9bb-e45e1dd88b6c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:35.540832 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 152/309] 10.222.0.70 () {60 vars in 1134 bytes} [Wed Aug 24 09:52:35 2022] POST /identity/v3/groups => generated 229 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:52:35.577457 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:35.578237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.578628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.578976 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.579762 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:35.580143 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:35.581785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:35.592415 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 158/310] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:35.599675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687165e0-8e85-4c98-a8e2-87f88a1f41ce None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.721677 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.731657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687165e0-8e85-4c98-a8e2-87f88a1f41ce None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:35.786319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038bd1-2cbd-4c44-a5c2-4a94a71046ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:35.786319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038bd1-2cbd-4c44-a5c2-4a94a71046ec None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.786319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038bd1-2cbd-4c44-a5c2-4a94a71046ec None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.786319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038bd1-2cbd-4c44-a5c2-4a94a71046ec None admin] PATH_INFO: `/v3/users/91013fd65ecb49a5873ffcc569be1864` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.806476 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae038bd1-2cbd-4c44-a5c2-4a94a71046ec None admin] RBAC: Authorizing `identity:get_user(user_id=91013fd65ecb49a5873ffcc569be1864)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:35.808151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae038bd1-2cbd-4c44-a5c2-4a94a71046ec None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:35.810953 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 153/311] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:35 2022] GET /identity/v3/users/91013fd65ecb49a5873ffcc569be1864 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:35.819716 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038bd1-2cbd-4c44-a5c2-4a94a71046ec None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.883650 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2654-51af-4384-9b8e-1c134bee3605 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:35.888591 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:35.921051 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:35.931324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7f583-8461-4115-bd4f-bbf3e66e177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:35.931324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f583-8461-4115-bd4f-bbf3e66e177b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.931324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f583-8461-4115-bd4f-bbf3e66e177b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.931324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f583-8461-4115-bd4f-bbf3e66e177b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.945082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7f583-8461-4115-bd4f-bbf3e66e177b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-32a7f583-8461-4115-bd4f-bbf3e66e177b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:35.951880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:35.952898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:35.954268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 159/312] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:35.963718 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7f583-8461-4115-bd4f-bbf3e66e177b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.969760 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038bd1-2cbd-4c44-a5c2-4a94a71046ec None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:36.025948 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:36.026733 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:36.027179 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:36.027623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:36.029157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] RBAC: Adding query filter params (role.id=08de461272ef44ab9862da985703cb23, user.id=91013fd65ecb49a5873ffcc569be1864, scope.system=all) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:36.029470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:36.032126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:36.048811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 154/313] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 24 09:52:35 2022] GET /identity/v3/role_assignments?user.id=91013fd65ecb49a5873ffcc569be1864&scope.system=all&role.id=08de461272ef44ab9862da985703cb23 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:36.106448 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7f583-8461-4115-bd4f-bbf3e66e177b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:36.147823 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:36.148449 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:36.148754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:36.149029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:36.149706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:36.150005 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:36.151420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:36.161465 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 160/314] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:36.169896 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:36.282816 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8fee1-d316-4360-be5c-a9d86b93778b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:36.297724 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:36.319393 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff17ec7-a805-4653-83c0-d7697532ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:36.320035 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff17ec7-a805-4653-83c0-d7697532ebfd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:36.320319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff17ec7-a805-4653-83c0-d7697532ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:36.320595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff17ec7-a805-4653-83c0-d7697532ebfd None admin] PATH_INFO: `/v3/users/8577dba71351447e85d918f92a4c962f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:36.321781 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff17ec7-a805-4653-83c0-d7697532ebfd None admin] RBAC: Authorizing `identity:get_user(user_id=8577dba71351447e85d918f92a4c962f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:36.323248 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff17ec7-a805-4653-83c0-d7697532ebfd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:36.325143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 155/315] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:36 2022] GET /identity/v3/users/8577dba71351447e85d918f92a4c962f => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:36.332110 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:36.391474 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:36.452052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b151-23e8-485f-b52f-6d55a4a77f30 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:36.486910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe676570-5573-47b6-9b1e-c7a01a6542b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:36.487516 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe676570-5573-47b6-9b1e-c7a01a6542b3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:36.487783 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe676570-5573-47b6-9b1e-c7a01a6542b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:36.488055 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe676570-5573-47b6-9b1e-c7a01a6542b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:36.558113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe676570-5573-47b6-9b1e-c7a01a6542b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:36.559705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe676570-5573-47b6-9b1e-c7a01a6542b3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:36.608467 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:36.663891 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 161/316] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:36.669374 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff17ec7-a805-4653-83c0-d7697532ebfd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:36.776065 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff17ec7-a805-4653-83c0-d7697532ebfd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:36.815385 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc9a7-7d8d-4fa2-b402-2a41ebe5289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:36.816025 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc9a7-7d8d-4fa2-b402-2a41ebe5289e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:36.816309 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc9a7-7d8d-4fa2-b402-2a41ebe5289e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:36.816584 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc9a7-7d8d-4fa2-b402-2a41ebe5289e None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:36.817759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abc9a7-7d8d-4fa2-b402-2a41ebe5289e None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:36.819226 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abc9a7-7d8d-4fa2-b402-2a41ebe5289e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:36.824792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 156/317] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:36 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:36.827350 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe676570-5573-47b6-9b1e-c7a01a6542b3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:36.951433 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe676570-5573-47b6-9b1e-c7a01a6542b3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:36.988123 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12253b13-1571-425e-837b-74cbc5e958f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:36.988781 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12253b13-1571-425e-837b-74cbc5e958f3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:36.989060 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12253b13-1571-425e-837b-74cbc5e958f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:36.989331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12253b13-1571-425e-837b-74cbc5e958f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:36.990068 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12253b13-1571-425e-837b-74cbc5e958f3 None admin] RBAC: Adding query filter params (role.id=08de461272ef44ab9862da985703cb23, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae, user.id=8577dba71351447e85d918f92a4c962f) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:36.990374 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12253b13-1571-425e-837b-74cbc5e958f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:36.991872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12253b13-1571-425e-837b-74cbc5e958f3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:36.998868 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 162/318] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:52:36 2022] GET /identity/v3/role_assignments?user.id=8577dba71351447e85d918f92a4c962f&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=08de461272ef44ab9862da985703cb23 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:37.518209 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ca15-d98a-4e7f-819c-4a32825bdfba None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:37.518765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ca15-d98a-4e7f-819c-4a32825bdfba None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:37.518765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ca15-d98a-4e7f-819c-4a32825bdfba None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:37.520237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 157/319] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:37.525442 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d882-944c-4bf6-a317-e4e425d5d41a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:37.525825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d882-944c-4bf6-a317-e4e425d5d41a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:37.525982 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d882-944c-4bf6-a317-e4e425d5d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:37.544210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-8c05d882-944c-4bf6-a317-e4e425d5d41a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:37.545428 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-8c05d882-944c-4bf6-a317-e4e425d5d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:37.548543 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:37.616310 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 163/320] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:37.924370 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611cc5-576b-48d9-b96c-309a903608bc None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:37.924650 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611cc5-576b-48d9-b96c-309a903608bc None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:37.925120 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611cc5-576b-48d9-b96c-309a903608bc None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:37.926463 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 158/321] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:37.931840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89799a-8774-40e2-bf3d-2e2f8254eebe None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:37.932133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89799a-8774-40e2-bf3d-2e2f8254eebe None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:37.932411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89799a-8774-40e2-bf3d-2e2f8254eebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:37.943492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f611cc5-576b-48d9-b96c-309a903608bc None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:37.951052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bb89799a-8774-40e2-bf3d-2e2f8254eebe None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:37.952248 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bb89799a-8774-40e2-bf3d-2e2f8254eebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:37.995603 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:38.023583 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 164/322] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:38.050211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f611cc5-576b-48d9-b96c-309a903608bc None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:38.085818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54439-88ec-41c0-aaec-b1b62a52c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:38.086668 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54439-88ec-41c0-aaec-b1b62a52c39a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.086956 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54439-88ec-41c0-aaec-b1b62a52c39a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.087227 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54439-88ec-41c0-aaec-b1b62a52c39a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.097633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54439-88ec-41c0-aaec-b1b62a52c39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-05e54439-88ec-41c0-aaec-b1b62a52c39a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:38.102467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:38.103358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:38.104164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 159/323] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:38.110049 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89799a-8774-40e2-bf3d-2e2f8254eebe None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:38.181688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:38.219230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89799a-8774-40e2-bf3d-2e2f8254eebe None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:38.258353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d7aef-bc57-428f-9dcf-7f9edc4591e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:38.258975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7aef-bc57-428f-9dcf-7f9edc4591e1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.259253 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7aef-bc57-428f-9dcf-7f9edc4591e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.259524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7aef-bc57-428f-9dcf-7f9edc4591e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.260188 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7aef-bc57-428f-9dcf-7f9edc4591e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:38.260594 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7aef-bc57-428f-9dcf-7f9edc4591e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:38.261962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7aef-bc57-428f-9dcf-7f9edc4591e1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:38.271029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 165/324] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:38.276636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54439-88ec-41c0-aaec-b1b62a52c39a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:38.344774 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92483f8-95e2-4e45-a2cc-cf809a917a07 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.345072 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92483f8-95e2-4e45-a2cc-cf809a917a07 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.345342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92483f8-95e2-4e45-a2cc-cf809a917a07 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.346708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 166/325] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:38.350486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92483f8-95e2-4e45-a2cc-cf809a917a07 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:38.386024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54439-88ec-41c0-aaec-b1b62a52c39a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:38.397197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:38.422676 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08698f6-aab7-4100-8f86-cc4fd70eefa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:38.423305 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08698f6-aab7-4100-8f86-cc4fd70eefa7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.423590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08698f6-aab7-4100-8f86-cc4fd70eefa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.423853 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08698f6-aab7-4100-8f86-cc4fd70eefa7 None admin] PATH_INFO: `/v3/users/15b7d5b2bc4540f5ab817fd0855949c9` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.425155 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08698f6-aab7-4100-8f86-cc4fd70eefa7 None admin] RBAC: Authorizing `identity:get_user(user_id=15b7d5b2bc4540f5ab817fd0855949c9)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:38.426473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08698f6-aab7-4100-8f86-cc4fd70eefa7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:38.428071 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 160/326] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:38 2022] GET /identity/v3/users/15b7d5b2bc4540f5ab817fd0855949c9 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:38.429243 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf845-1ae7-4ef3-aa54-03ec089ae185 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.429525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf845-1ae7-4ef3-aa54-03ec089ae185 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.429797 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf845-1ae7-4ef3-aa54-03ec089ae185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.447742 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-b8ebf845-1ae7-4ef3-aa54-03ec089ae185 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:38.448889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b8ebf845-1ae7-4ef3-aa54-03ec089ae185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:38.457426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92483f8-95e2-4e45-a2cc-cf809a917a07 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:38.490283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:38.495968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988f8ae-2eff-406b-b8da-3db0c65b1fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:38.496603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988f8ae-2eff-406b-b8da-3db0c65b1fa8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.496905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988f8ae-2eff-406b-b8da-3db0c65b1fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.497283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988f8ae-2eff-406b-b8da-3db0c65b1fa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.498423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988f8ae-2eff-406b-b8da-3db0c65b1fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:38.499887 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988f8ae-2eff-406b-b8da-3db0c65b1fa8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:38.501553 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 167/327] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:52:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:38.502323 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988f8ae-2eff-406b-b8da-3db0c65b1fa8 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:38.521284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 161/328] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:38.526237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebf845-1ae7-4ef3-aa54-03ec089ae185 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:38.641901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988f8ae-2eff-406b-b8da-3db0c65b1fa8 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:38.647250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebf845-1ae7-4ef3-aa54-03ec089ae185 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:38.658600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:38.687000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9275c-632c-4c04-ad5d-47478d72723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:38.687607 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9275c-632c-4c04-ad5d-47478d72723e None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.687889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9275c-632c-4c04-ad5d-47478d72723e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.688162 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9275c-632c-4c04-ad5d-47478d72723e None admin] PATH_INFO: `/v3/groups` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.688798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9275c-632c-4c04-ad5d-47478d72723e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:38.690236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9275c-632c-4c04-ad5d-47478d72723e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:38.700640 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:38.702020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.702541 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.703539 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.704942 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] RBAC: Adding query filter params (role.id=74f67ab31fb74494b29826e8e6fd77cc, user.id=15b7d5b2bc4540f5ab817fd0855949c9, scope.system=all) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:38.705545 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:38.708221 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:38.708971 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 162/329] 10.222.0.70 () {60 vars in 1134 bytes} [Wed Aug 24 09:52:38 2022] POST /identity/v3/groups => generated 226 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:52:38.731933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 168/330] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 24 09:52:38 2022] GET /identity/v3/role_assignments?user.id=15b7d5b2bc4540f5ab817fd0855949c9&scope.system=all&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:38.857668 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9275c-632c-4c04-ad5d-47478d72723e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:38.999337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9275c-632c-4c04-ad5d-47478d72723e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:39.037341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f8a27-24fb-4e72-8e7c-3f5f7f5dbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:39.038340 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8a27-24fb-4e72-8e7c-3f5f7f5dbc81 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:39.038823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8a27-24fb-4e72-8e7c-3f5f7f5dbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:39.039326 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8a27-24fb-4e72-8e7c-3f5f7f5dbc81 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:39.052247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f8a27-24fb-4e72-8e7c-3f5f7f5dbc81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-e37f8a27-24fb-4e72-8e7c-3f5f7f5dbc81 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:39.057574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:39.058960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:39.060107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 163/331] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:39.067377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:39.151801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:39.199293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be9de9-828b-464c-827d-26733c8cca15 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:39.238515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:39.239127 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:39.239402 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:39.239672 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:39.240333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:39.240629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:39.242055 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:39.252034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 169/332] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:39.257521 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f8a27-24fb-4e72-8e7c-3f5f7f5dbc81 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:39.290461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:39.389047 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f8a27-24fb-4e72-8e7c-3f5f7f5dbc81 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:39.430795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372c81b-9ba2-4224-93f8-df5bba7d6594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:39.431822 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372c81b-9ba2-4224-93f8-df5bba7d6594 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:39.432344 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372c81b-9ba2-4224-93f8-df5bba7d6594 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:39.432829 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372c81b-9ba2-4224-93f8-df5bba7d6594 None admin] PATH_INFO: `/v3/users/91013fd65ecb49a5873ffcc569be1864` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:39.434275 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372c81b-9ba2-4224-93f8-df5bba7d6594 None admin] RBAC: Authorizing `identity:get_user(user_id=91013fd65ecb49a5873ffcc569be1864)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:39.435930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372c81b-9ba2-4224-93f8-df5bba7d6594 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:39.438667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 164/333] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:39 2022] GET /identity/v3/users/91013fd65ecb49a5873ffcc569be1864 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:39.444910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:39.571295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8421c4-839b-4bc5-bec7-335ae1c1fe73 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:39.592080 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:39.606712 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee3257-f9b3-45a5-8c7c-dddb2bfa8037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:39.607913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee3257-f9b3-45a5-8c7c-dddb2bfa8037 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:39.608191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee3257-f9b3-45a5-8c7c-dddb2bfa8037 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:39.608492 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee3257-f9b3-45a5-8c7c-dddb2bfa8037 None admin] PATH_INFO: `/v3/system/users/91013fd65ecb49a5873ffcc569be1864/roles/08de461272ef44ab9862da985703cb23` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:39.610417 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee3257-f9b3-45a5-8c7c-dddb2bfa8037 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=91013fd65ecb49a5873ffcc569be1864, role_id=08de461272ef44ab9862da985703cb23)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:39.611800 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee3257-f9b3-45a5-8c7c-dddb2bfa8037 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:39.626857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 170/334] 10.222.0.70 () {58 vars in 1334 bytes} [Wed Aug 24 09:52:39 2022] PUT /identity/v3/system/users/91013fd65ecb49a5873ffcc569be1864/roles/08de461272ef44ab9862da985703cb23 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:41.480282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce125c8-2ad4-421a-8f4f-13c215fdea02 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:41.480831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce125c8-2ad4-421a-8f4f-13c215fdea02 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:41.480831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce125c8-2ad4-421a-8f4f-13c215fdea02 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:41.482554 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 165/335] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:41.489991 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd72c4-7375-4d89-8f78-def20f456d4d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:41.490487 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd72c4-7375-4d89-8f78-def20f456d4d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:41.490563 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd72c4-7375-4d89-8f78-def20f456d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:41.514229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-36bd72c4-7375-4d89-8f78-def20f456d4d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:41.515613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-36bd72c4-7375-4d89-8f78-def20f456d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:41.617997 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 171/336] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:41.780866 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2501c-4c52-45b3-807f-4b4041cceb75 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:41.781230 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2501c-4c52-45b3-807f-4b4041cceb75 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:41.781987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2501c-4c52-45b3-807f-4b4041cceb75 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:41.783650 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 166/337] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:41.791715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec98d0-5e33-4701-9d48-86959e647071 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:41.791994 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec98d0-5e33-4701-9d48-86959e647071 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:41.792270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec98d0-5e33-4701-9d48-86959e647071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:41.816620 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-96ec98d0-5e33-4701-9d48-86959e647071 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:41.817840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-96ec98d0-5e33-4701-9d48-86959e647071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:41.907352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 172/338] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:42.234286 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2501c-4c52-45b3-807f-4b4041cceb75 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:42.345879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:42.353694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2501c-4c52-45b3-807f-4b4041cceb75 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:42.398635 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40d81-1bca-4568-89be-26c9599e9c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:42.399452 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40d81-1bca-4568-89be-26c9599e9c82 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.399733 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40d81-1bca-4568-89be-26c9599e9c82 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.400014 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40d81-1bca-4568-89be-26c9599e9c82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:42.415000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab40d81-1bca-4568-89be-26c9599e9c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-8ab40d81-1bca-4568-89be-26c9599e9c82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:42.419845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:42.420847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:42.422221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 167/339] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:42.430032 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec98d0-5e33-4701-9d48-86959e647071 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:42.481369 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:42.518048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40d81-1bca-4568-89be-26c9599e9c82 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:42.567289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec98d0-5e33-4701-9d48-86959e647071 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:42.606830 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbddfda-69fc-4c6f-829d-868f4118808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:42.608470 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbddfda-69fc-4c6f-829d-868f4118808c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.609652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbddfda-69fc-4c6f-829d-868f4118808c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.610220 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbddfda-69fc-4c6f-829d-868f4118808c None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:42.611834 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbddfda-69fc-4c6f-829d-868f4118808c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:42.612508 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbddfda-69fc-4c6f-829d-868f4118808c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:42.615553 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbddfda-69fc-4c6f-829d-868f4118808c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:42.642327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 173/340] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:42.644311 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd12c9-3809-4913-9999-5143c55d712e None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.646028 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd12c9-3809-4913-9999-5143c55d712e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.647367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd12c9-3809-4913-9999-5143c55d712e None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:42.650725 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 174/341] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:42.652968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd12c9-3809-4913-9999-5143c55d712e None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:42.723834 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40d81-1bca-4568-89be-26c9599e9c82 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:42.770944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab424454-2069-48cf-a673-a562593733e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:42.771972 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab424454-2069-48cf-a673-a562593733e7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.772452 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab424454-2069-48cf-a673-a562593733e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.773000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab424454-2069-48cf-a673-a562593733e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:42.788037 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab424454-2069-48cf-a673-a562593733e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-ab424454-2069-48cf-a673-a562593733e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:42.796211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:42.797792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:42.798621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:42.804555 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 168/342] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:42.806642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364764-4cda-47fe-8232-253129c0a6c8 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.807134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364764-4cda-47fe-8232-253129c0a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.807601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1364764-4cda-47fe-8232-253129c0a6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:42.830811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e1364764-4cda-47fe-8232-253129c0a6c8 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:42.832242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e1364764-4cda-47fe-8232-253129c0a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:42.853430 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:42.883954 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd12c9-3809-4913-9999-5143c55d712e None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:42.901590 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:42.924696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 169/343] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:42.924696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f658-7eed-4410-ac96-b1b66730ed1d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.924696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f658-7eed-4410-ac96-b1b66730ed1d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.924696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665f658-7eed-4410-ac96-b1b66730ed1d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:42.924696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 170/344] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:42.925148 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665f658-7eed-4410-ac96-b1b66730ed1d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:42.940382 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c073c0-3fd3-4cd8-80c5-161f526b94a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:42.941573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c073c0-3fd3-4cd8-80c5-161f526b94a4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.942004 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c073c0-3fd3-4cd8-80c5-161f526b94a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.942683 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c073c0-3fd3-4cd8-80c5-161f526b94a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.085695 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c073c0-3fd3-4cd8-80c5-161f526b94a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:43.087175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c073c0-3fd3-4cd8-80c5-161f526b94a4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:43.128356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665f658-7eed-4410-ac96-b1b66730ed1d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:43.197098 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7bcb8-5926-4326-9091-a4fa78954538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:43.197711 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7bcb8-5926-4326-9091-a4fa78954538 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.197991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7bcb8-5926-4326-9091-a4fa78954538 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.198263 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7bcb8-5926-4326-9091-a4fa78954538 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7bcb8-5926-4326-9091-a4fa78954538 None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:43.199229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7bcb8-5926-4326-9091-a4fa78954538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:43.200626 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7bcb8-5926-4326-9091-a4fa78954538 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:43.217074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 171/345] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:43.219198 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4294-4fa0-4174-b02c-52a55233824d None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.219492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4294-4fa0-4174-b02c-52a55233824d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.219761 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4294-4fa0-4174-b02c-52a55233824d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.244559 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ec8a4294-4fa0-4174-b02c-52a55233824d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:43.246392 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ec8a4294-4fa0-4174-b02c-52a55233824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:43.253000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.259975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 175/346] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:43.261275 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2945a2-d2a4-4282-8b16-e26f5cb1464f None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.261556 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2945a2-d2a4-4282-8b16-e26f5cb1464f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.261825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2945a2-d2a4-4282-8b16-e26f5cb1464f None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.263225 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 176/347] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:43.263837 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2945a2-d2a4-4282-8b16-e26f5cb1464f None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:43.278449 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.358476 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 172/348] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:43.359374 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a4294-4fa0-4174-b02c-52a55233824d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:43.416864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2945a2-d2a4-4282-8b16-e26f5cb1464f None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:43.455907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de64c60-da51-4f34-ae68-e57998e61380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:43.456464 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de64c60-da51-4f34-ae68-e57998e61380 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.456818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de64c60-da51-4f34-ae68-e57998e61380 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.457095 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de64c60-da51-4f34-ae68-e57998e61380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.492959 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a4294-4fa0-4174-b02c-52a55233824d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:43.533568 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de64c60-da51-4f34-ae68-e57998e61380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:43.534303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4485d03-599c-4294-90ef-9152f0a7992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:43.535048 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de64c60-da51-4f34-ae68-e57998e61380 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:43.535712 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4485d03-599c-4294-90ef-9152f0a7992b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.536171 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4485d03-599c-4294-90ef-9152f0a7992b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.536605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4485d03-599c-4294-90ef-9152f0a7992b None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.538037 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4485d03-599c-4294-90ef-9152f0a7992b None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:43.539759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4485d03-599c-4294-90ef-9152f0a7992b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:43.542026 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 173/349] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:43 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:43.543408 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3eac9-f981-428f-8bd1-116f4d6482ac None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.543871 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3eac9-f981-428f-8bd1-116f4d6482ac None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.544397 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3eac9-f981-428f-8bd1-116f4d6482ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.548810 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.561062 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.569480 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8ba3eac9-f981-428f-8bd1-116f4d6482ac None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:43.571319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8ba3eac9-f981-428f-8bd1-116f4d6482ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:43.648005 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 177/350] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:43.652512 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 174/351] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:43.654415 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de64c60-da51-4f34-ae68-e57998e61380 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:43.655009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3eac9-f981-428f-8bd1-116f4d6482ac None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:43.763635 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de64c60-da51-4f34-ae68-e57998e61380 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:43.773772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.789679 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3eac9-f981-428f-8bd1-116f4d6482ac None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:43.804690 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b4fc9-013d-44c4-8340-86361a85c065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:43.805333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b4fc9-013d-44c4-8340-86361a85c065 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.805611 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b4fc9-013d-44c4-8340-86361a85c065 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.805890 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b4fc9-013d-44c4-8340-86361a85c065 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.817591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b4fc9-013d-44c4-8340-86361a85c065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-c84b4fc9-013d-44c4-8340-86361a85c065 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:43.822370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:43.823370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:43.824207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:43.828352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 178/352] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:43.829263 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b4fc9-013d-44c4-8340-86361a85c065 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:43.834338 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1a085-b4bb-4012-905e-0b7a7a1e5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:43.835243 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1a085-b4bb-4012-905e-0b7a7a1e5b5b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.835670 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1a085-b4bb-4012-905e-0b7a7a1e5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.836090 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1a085-b4bb-4012-905e-0b7a7a1e5b5b None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.840414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.844772 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1a085-b4bb-4012-905e-0b7a7a1e5b5b None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:43.847182 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1a085-b4bb-4012-905e-0b7a7a1e5b5b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:43.848697 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 175/353] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:43 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:43.849653 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1a085-b4bb-4012-905e-0b7a7a1e5b5b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:43.943939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b4fc9-013d-44c4-8340-86361a85c065 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:43.975213 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1a085-b4bb-4012-905e-0b7a7a1e5b5b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:43.985121 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740da0-b089-4ac0-95ee-278cfffddb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:43.985760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740da0-b089-4ac0-95ee-278cfffddb73 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.986041 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740da0-b089-4ac0-95ee-278cfffddb73 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.986310 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740da0-b089-4ac0-95ee-278cfffddb73 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.987473 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46740da0-b089-4ac0-95ee-278cfffddb73 None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:43.989155 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46740da0-b089-4ac0-95ee-278cfffddb73 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:43.990614 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 179/354] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:43 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:43.995974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740da0-b089-4ac0-95ee-278cfffddb73 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.017145 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952121c-6ffb-4629-a291-cf99d1a3eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.018157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952121c-6ffb-4629-a291-cf99d1a3eb7e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.018669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952121c-6ffb-4629-a291-cf99d1a3eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.019196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952121c-6ffb-4629-a291-cf99d1a3eb7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.032378 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952121c-6ffb-4629-a291-cf99d1a3eb7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:44.033342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0952121c-6ffb-4629-a291-cf99d1a3eb7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:44.039809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:44.042116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:52:44.042962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:44.045583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 176/355] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:44.046761 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952121c-6ffb-4629-a291-cf99d1a3eb7e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.110069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740da0-b089-4ac0-95ee-278cfffddb73 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:44.120478 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:44.148759 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.149379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.149660 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.149934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.150597 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:44.150899 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:44.152771 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:44.162283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 180/356] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:44.163053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.170158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952121c-6ffb-4629-a291-cf99d1a3eb7e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:44.215449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.216096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.216587 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.216797 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.217420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] RBAC: Adding query filter params (group.id=5887f8016e20478b91a75ef389f669cc, role.id=c4c1742a54eb440c9d94f137cb668187, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:44.217733 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:44.220028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:44.228840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 177/357] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:44 2022] GET /identity/v3/role_assignments?group.id=5887f8016e20478b91a75ef389f669cc&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=c4c1742a54eb440c9d94f137cb668187 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:44.228840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.304626 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:44.314787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112400ee-cd0d-409a-8201-bfff9b56d067 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:44.362455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa9f10-cbfc-4c81-89d1-daccad2fc7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.364066 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9f10-cbfc-4c81-89d1-daccad2fc7e8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.364066 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9f10-cbfc-4c81-89d1-daccad2fc7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.364066 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9f10-cbfc-4c81-89d1-daccad2fc7e8 None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.365452 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa9f10-cbfc-4c81-89d1-daccad2fc7e8 None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:44.367027 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa9f10-cbfc-4c81-89d1-daccad2fc7e8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:44.368787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 181/358] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:44 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:44.370036 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5302e-5aed-457a-9ce0-3ba85e26a22e None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.370424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5302e-5aed-457a-9ce0-3ba85e26a22e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.370698 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5302e-5aed-457a-9ce0-3ba85e26a22e None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.372189 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 182/359] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:44.372928 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5302e-5aed-457a-9ce0-3ba85e26a22e None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.384983 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68a45c-f0bb-41a9-8fa1-28859c361e84 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:44.415920 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:44.434670 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.435222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.435504 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.435780 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.436460 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:44.436794 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:44.438828 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:44.450101 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 178/360] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:44.450879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.520426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5302e-5aed-457a-9ce0-3ba85e26a22e None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:44.563347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875c78-1e3d-40ce-a865-91279fbc67b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.563990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875c78-1e3d-40ce-a865-91279fbc67b3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.564269 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875c78-1e3d-40ce-a865-91279fbc67b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.564754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875c78-1e3d-40ce-a865-91279fbc67b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.576431 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15875c78-1e3d-40ce-a865-91279fbc67b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:44.577625 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e837b-837a-4751-923e-b3c9d37f984a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-15875c78-1e3d-40ce-a865-91279fbc67b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:44.582555 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:44.583607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:44.584434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 183/361] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:44.585182 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875c78-1e3d-40ce-a865-91279fbc67b3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.613539 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:44.632811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023499a-adca-4b7c-8a29-239447630fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.634290 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023499a-adca-4b7c-8a29-239447630fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.634571 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023499a-adca-4b7c-8a29-239447630fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.634842 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023499a-adca-4b7c-8a29-239447630fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.706986 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:44.724959 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023499a-adca-4b7c-8a29-239447630fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:44.726433 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023499a-adca-4b7c-8a29-239447630fd0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:44.727926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875c78-1e3d-40ce-a865-91279fbc67b3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:44.777576 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8b4d2-cad2-4bd2-a3e6-0456d3211de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.777576 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8b4d2-cad2-4bd2-a3e6-0456d3211de5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.777576 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8b4d2-cad2-4bd2-a3e6-0456d3211de5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.777576 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8b4d2-cad2-4bd2-a3e6-0456d3211de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.777997 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8b4d2-cad2-4bd2-a3e6-0456d3211de5 None admin] RBAC: Adding query filter params (group.id=5887f8016e20478b91a75ef389f669cc, role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:44.777997 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8b4d2-cad2-4bd2-a3e6-0456d3211de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:44.777997 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8b4d2-cad2-4bd2-a3e6-0456d3211de5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:44.782813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 184/362] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:44 2022] GET /identity/v3/role_assignments?group.id=5887f8016e20478b91a75ef389f669cc&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:44.784132 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd01b-56ba-40e7-8083-6cbb95ca79d3 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.784501 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd01b-56ba-40e7-8083-6cbb95ca79d3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.784797 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fd01b-56ba-40e7-8083-6cbb95ca79d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.806618 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-5b9fd01b-56ba-40e7-8083-6cbb95ca79d3 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:44.808056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-5b9fd01b-56ba-40e7-8083-6cbb95ca79d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:44.863333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 179/363] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:44.864527 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023499a-adca-4b7c-8a29-239447630fd0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.901771 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 185/364] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:44.903022 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fd01b-56ba-40e7-8083-6cbb95ca79d3 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:44.935304 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:45.030943 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:45.043903 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fd01b-56ba-40e7-8083-6cbb95ca79d3 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.054872 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023499a-adca-4b7c-8a29-239447630fd0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.105042 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.106074 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.106801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.107950 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.109017 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:45.110224 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:45.112563 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:45.132106 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 186/365] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:45.133091 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec736a0-5082-4750-b685-c0ded57a3fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.133970 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec736a0-5082-4750-b685-c0ded57a3fe3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.135081 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:45.135601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec736a0-5082-4750-b685-c0ded57a3fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.136067 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec736a0-5082-4750-b685-c0ded57a3fe3 None admin] PATH_INFO: `/v3/users/91013fd65ecb49a5873ffcc569be1864` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.140039 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec736a0-5082-4750-b685-c0ded57a3fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=91013fd65ecb49a5873ffcc569be1864)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:45.141878 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec736a0-5082-4750-b685-c0ded57a3fe3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:45.145272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 180/366] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 24 09:52:44 2022] GET /identity/v3/users/91013fd65ecb49a5873ffcc569be1864 => generated 293 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:45.146300 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec736a0-5082-4750-b685-c0ded57a3fe3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:45.291515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:45.328327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c067b3-fda3-46a4-b15c-80d008384a14 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.354380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec736a0-5082-4750-b685-c0ded57a3fe3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.394385 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9658088-f41f-4a19-b4be-b26c271b7bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.395433 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9658088-f41f-4a19-b4be-b26c271b7bd9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.395996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9658088-f41f-4a19-b4be-b26c271b7bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.396688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9658088-f41f-4a19-b4be-b26c271b7bd9 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.399440 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9658088-f41f-4a19-b4be-b26c271b7bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:45.401941 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9658088-f41f-4a19-b4be-b26c271b7bd9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:45.404720 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 187/367] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:45 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:45.407516 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9658088-f41f-4a19-b4be-b26c271b7bd9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:45.428728 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b66a9-b10c-4acd-bfbe-6d7d01a187aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.429780 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b66a9-b10c-4acd-bfbe-6d7d01a187aa None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.430279 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b66a9-b10c-4acd-bfbe-6d7d01a187aa None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.430778 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b66a9-b10c-4acd-bfbe-6d7d01a187aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.476258 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:45.563237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b66a9-b10c-4acd-bfbe-6d7d01a187aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:45.566050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b66a9-b10c-4acd-bfbe-6d7d01a187aa None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:45.579587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9658088-f41f-4a19-b4be-b26c271b7bd9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.637231 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.638081 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.638574 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.638981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.639935 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] RBAC: Adding query filter params (role.id=08de461272ef44ab9862da985703cb23, user.id=91013fd65ecb49a5873ffcc569be1864, scope.system=all) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:45.641031 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:45.642789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:45.656998 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 188/368] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 24 09:52:45 2022] GET /identity/v3/role_assignments?user.id=91013fd65ecb49a5873ffcc569be1864&scope.system=all&role.id=08de461272ef44ab9862da985703cb23 => generated 510 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:45.658062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:45.673988 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:45.710106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 181/369] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:45.711566 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b66a9-b10c-4acd-bfbe-6d7d01a187aa None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:45.784650 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:45.826313 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad9c43-0b52-4223-ba0d-ae8e66f85127 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.852997 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b66a9-b10c-4acd-bfbe-6d7d01a187aa None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.877542 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971f6b-3358-4feb-ae90-74d245fa361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.878214 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971f6b-3358-4feb-ae90-74d245fa361a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.878497 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971f6b-3358-4feb-ae90-74d245fa361a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.878822 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971f6b-3358-4feb-ae90-74d245fa361a None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.880098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e971f6b-3358-4feb-ae90-74d245fa361a None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:45.881692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e971f6b-3358-4feb-ae90-74d245fa361a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:45.884138 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 189/370] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:45 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:45.884283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971f6b-3358-4feb-ae90-74d245fa361a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:45.900942 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cc90c-f3cf-4f1f-90a7-9b78873b8ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.901849 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cc90c-f3cf-4f1f-90a7-9b78873b8ca9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.902303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cc90c-f3cf-4f1f-90a7-9b78873b8ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.902718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cc90c-f3cf-4f1f-90a7-9b78873b8ca9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.921126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cc90c-f3cf-4f1f-90a7-9b78873b8ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-666cc90c-f3cf-4f1f-90a7-9b78873b8ca9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:45.926333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:45.927500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:45.928375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:45.930870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 182/371] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:45.931879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cc90c-f3cf-4f1f-90a7-9b78873b8ca9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:46.000762 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:46.046318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971f6b-3358-4feb-ae90-74d245fa361a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.060002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cc90c-f3cf-4f1f-90a7-9b78873b8ca9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.078823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:46.104234 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.105487 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.106068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.106629 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.108046 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] RBAC: Adding query filter params (group.id=5887f8016e20478b91a75ef389f669cc, role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:46.108780 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.109538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab99d4-ac70-4797-afae-42614e82e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.110200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab99d4-ac70-4797-afae-42614e82e09b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.110479 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab99d4-ac70-4797-afae-42614e82e09b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.110749 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab99d4-ac70-4797-afae-42614e82e09b None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.112125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab99d4-ac70-4797-afae-42614e82e09b None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.112646 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.113600 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab99d4-ac70-4797-afae-42614e82e09b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.115600 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 190/372] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:45 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:46.116416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab99d4-ac70-4797-afae-42614e82e09b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:46.125978 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 183/373] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:45 2022] GET /identity/v3/role_assignments?group.id=5887f8016e20478b91a75ef389f669cc&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:46.127825 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:46.252212 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64913ab7-4d5d-4d50-87d1-56b03c924f8e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.254020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab99d4-ac70-4797-afae-42614e82e09b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.293359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.293977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.294092 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d749a2d-be2f-44ae-bc9a-46a575e62523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.294248 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.294515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.295176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:46.295286 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749a2d-be2f-44ae-bc9a-46a575e62523 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.295468 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.295824 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749a2d-be2f-44ae-bc9a-46a575e62523 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.296236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d749a2d-be2f-44ae-bc9a-46a575e62523 None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.297495 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.298270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d749a2d-be2f-44ae-bc9a-46a575e62523 None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.300075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d749a2d-be2f-44ae-bc9a-46a575e62523 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.302245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 184/374] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:46 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:46.307282 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 191/375] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:46.313620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d749a2d-be2f-44ae-bc9a-46a575e62523 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:46.315670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:46.320586 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:46.373443 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:46.428839 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca46ff-b0d7-49e3-8142-d0578122276e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.439520 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d749a2d-be2f-44ae-bc9a-46a575e62523 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.466330 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.467058 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.467381 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.467721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.468960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] RBAC: Adding query filter params (group.id=5887f8016e20478b91a75ef389f669cc, role.id=c4c1742a54eb440c9d94f137cb668187, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:46.469240 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.470772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.481666 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 192/376] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:46 2022] GET /identity/v3/role_assignments?group.id=5887f8016e20478b91a75ef389f669cc&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=c4c1742a54eb440c9d94f137cb668187 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:46.481924 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee883b90-b8e9-4e40-933a-66a186e9b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.482570 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee883b90-b8e9-4e40-933a-66a186e9b030 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.482854 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee883b90-b8e9-4e40-933a-66a186e9b030 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.483122 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee883b90-b8e9-4e40-933a-66a186e9b030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.581351 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee883b90-b8e9-4e40-933a-66a186e9b030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.583199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee883b90-b8e9-4e40-933a-66a186e9b030 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.640259 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:46.707245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 185/377] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:46.712885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:46.799764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:46.835921 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fc62d-27b3-4a1e-8b49-b114cd9b18e7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.872917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727deeaf-5a7c-4637-bd87-c7d700087c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.873554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727deeaf-5a7c-4637-bd87-c7d700087c65 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.873830 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727deeaf-5a7c-4637-bd87-c7d700087c65 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.874100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727deeaf-5a7c-4637-bd87-c7d700087c65 None admin] PATH_INFO: `/v3/projects/928770adba0b40bd87bea18febe221ea` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.875272 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727deeaf-5a7c-4637-bd87-c7d700087c65 None admin] RBAC: Authorizing `identity:get_project(project_id=928770adba0b40bd87bea18febe221ea)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.876718 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727deeaf-5a7c-4637-bd87-c7d700087c65 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.878639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 193/378] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:46 2022] GET /identity/v3/projects/928770adba0b40bd87bea18febe221ea => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:46.884111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee883b90-b8e9-4e40-933a-66a186e9b030 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:47.043722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee883b90-b8e9-4e40-933a-66a186e9b030 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:47.089729 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3b3b8-c9ce-4a28-b57a-836238d06dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:47.090422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b3b8-c9ce-4a28-b57a-836238d06dbc None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:47.090703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b3b8-c9ce-4a28-b57a-836238d06dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:47.090979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b3b8-c9ce-4a28-b57a-836238d06dbc None admin] PATH_INFO: `/v3/groups/2b3cd017980d4922b0da1c70b02e0d11` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:47.099063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3b3b8-c9ce-4a28-b57a-836238d06dbc None admin] RBAC: Authorizing `identity:get_group(group_id=2b3cd017980d4922b0da1c70b02e0d11)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:47.100746 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3b3b8-c9ce-4a28-b57a-836238d06dbc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:47.102776 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 186/379] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:46 2022] GET /identity/v3/groups/2b3cd017980d4922b0da1c70b02e0d11 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:47.109869 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727deeaf-5a7c-4637-bd87-c7d700087c65 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:47.233746 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727deeaf-5a7c-4637-bd87-c7d700087c65 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:47.272009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d07174-2b72-4b2c-923c-841d29f75274 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:47.272382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d07174-2b72-4b2c-923c-841d29f75274 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:47.272548 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d07174-2b72-4b2c-923c-841d29f75274 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:47.273603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82a8cb-0e96-45e6-b388-fca0498befd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:47.274253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 187/380] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:47.274355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a8cb-0e96-45e6-b388-fca0498befd9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:47.274558 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a8cb-0e96-45e6-b388-fca0498befd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:47.274838 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82a8cb-0e96-45e6-b388-fca0498befd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:47.275633 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82a8cb-0e96-45e6-b388-fca0498befd9 None admin] RBAC: Adding query filter params (group.id=2b3cd017980d4922b0da1c70b02e0d11, role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=928770adba0b40bd87bea18febe221ea) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:47.275948 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82a8cb-0e96-45e6-b388-fca0498befd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:47.277428 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82a8cb-0e96-45e6-b388-fca0498befd9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:47.279710 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54e284-6908-4c0f-8d62-44cbecf1cdd9 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:47.280186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54e284-6908-4c0f-8d62-44cbecf1cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:47.280636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54e284-6908-4c0f-8d62-44cbecf1cdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:47.285100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:47.288191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 194/381] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:47 2022] GET /identity/v3/role_assignments?group.id=2b3cd017980d4922b0da1c70b02e0d11&scope.project.id=928770adba0b40bd87bea18febe221ea&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:47.303556 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6f54e284-6908-4c0f-8d62-44cbecf1cdd9 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:47.305532 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6f54e284-6908-4c0f-8d62-44cbecf1cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:47.309302 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:47.404368 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 188/382] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:47.808174 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770933a3-caf9-49cf-bc41-6d8cbbce9f7c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:47.808551 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770933a3-caf9-49cf-bc41-6d8cbbce9f7c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:47.808858 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770933a3-caf9-49cf-bc41-6d8cbbce9f7c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:47.810245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 195/383] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:47.820379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb8b72-6ab0-4d0c-b95e-af52184e8441 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:47.820736 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb8b72-6ab0-4d0c-b95e-af52184e8441 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:47.820974 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb8b72-6ab0-4d0c-b95e-af52184e8441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:47.840812 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-89cb8b72-6ab0-4d0c-b95e-af52184e8441 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:47.842060 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-89cb8b72-6ab0-4d0c-b95e-af52184e8441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:47.927139 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 189/384] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:47.953423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770933a3-caf9-49cf-bc41-6d8cbbce9f7c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:48.080931 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770933a3-caf9-49cf-bc41-6d8cbbce9f7c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:48.121123 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb23b-ae89-4c6f-a0e5-8339f250b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:48.121760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb23b-ae89-4c6f-a0e5-8339f250b10f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:48.122036 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb23b-ae89-4c6f-a0e5-8339f250b10f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:48.122305 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb23b-ae89-4c6f-a0e5-8339f250b10f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:48.133191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb23b-ae89-4c6f-a0e5-8339f250b10f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-4ebdb23b-ae89-4c6f-a0e5-8339f250b10f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:48.138520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:48.139455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:48.140327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 196/385] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:48.147183 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb8b72-6ab0-4d0c-b95e-af52184e8441 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:48.217322 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:48.251855 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb8b72-6ab0-4d0c-b95e-af52184e8441 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:48.287695 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:48.288312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:48.288642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:48.288940 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:48.289648 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:48.289951 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:48.291306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:48.303485 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 190/386] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:48.309163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb23b-ae89-4c6f-a0e5-8339f250b10f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:48.389633 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:48.433885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb23b-ae89-4c6f-a0e5-8339f250b10f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:48.473591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32f60-042c-4a89-8406-cf10697ec79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:48.474231 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32f60-042c-4a89-8406-cf10697ec79f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:48.474505 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32f60-042c-4a89-8406-cf10697ec79f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:48.474772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32f60-042c-4a89-8406-cf10697ec79f None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:48.475882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed32f60-042c-4a89-8406-cf10697ec79f None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:48.477346 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed32f60-042c-4a89-8406-cf10697ec79f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:48.479225 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 197/387] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:48 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:48.484983 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:48.604315 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67fbf1-e603-427e-a7cd-7952ac32d081 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:48.638402 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:48.644853 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d015cd-847c-4c90-8235-0fbb92bda3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:48.647803 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d015cd-847c-4c90-8235-0fbb92bda3af None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:48.648086 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d015cd-847c-4c90-8235-0fbb92bda3af None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:48.648356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d015cd-847c-4c90-8235-0fbb92bda3af None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:48.649674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d015cd-847c-4c90-8235-0fbb92bda3af None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:48.651326 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d015cd-847c-4c90-8235-0fbb92bda3af None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:48.653106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 191/388] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:48 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:48.659631 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32f60-042c-4a89-8406-cf10697ec79f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:48.694881 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d015cd-847c-4c90-8235-0fbb92bda3af None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:48.847759 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32f60-042c-4a89-8406-cf10697ec79f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:48.901990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:48.911689 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d015cd-847c-4c90-8235-0fbb92bda3af None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:48.922397 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d60544-1adc-401c-95e8-62d4c5b952c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:48.923137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d60544-1adc-401c-95e8-62d4c5b952c5 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:48.923414 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d60544-1adc-401c-95e8-62d4c5b952c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:48.923679 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d60544-1adc-401c-95e8-62d4c5b952c5 None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/groups/5887f8016e20478b91a75ef389f669cc/roles/c4c1742a54eb440c9d94f137cb668187` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:48.925926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d60544-1adc-401c-95e8-62d4c5b952c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=025a96e9ed2b499596ba4f54f4b8ab08, group_id=5887f8016e20478b91a75ef389f669cc, role_id=c4c1742a54eb440c9d94f137cb668187)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:48.927388 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d60544-1adc-401c-95e8-62d4c5b952c5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:48.950617 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 198/389] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 09:52:48 2022] PUT /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/groups/5887f8016e20478b91a75ef389f669cc/roles/c4c1742a54eb440c9d94f137cb668187 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:48.973291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389009-b89c-451c-bd56-24be6f5dbdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:48.974095 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389009-b89c-451c-bd56-24be6f5dbdc4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:48.974200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389009-b89c-451c-bd56-24be6f5dbdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:48.974468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389009-b89c-451c-bd56-24be6f5dbdc4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:48.995476 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389009-b89c-451c-bd56-24be6f5dbdc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a5389009-b89c-451c-bd56-24be6f5dbdc4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:49.001054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:49.002007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:49.002899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 192/390] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:49.011142 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d60544-1adc-401c-95e8-62d4c5b952c5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:49.194091 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d60544-1adc-401c-95e8-62d4c5b952c5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:49.233814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354616a-247d-4a30-aa6a-02759a154377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:49.234478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354616a-247d-4a30-aa6a-02759a154377 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.234756 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354616a-247d-4a30-aa6a-02759a154377 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.235024 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354616a-247d-4a30-aa6a-02759a154377 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.235692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354616a-247d-4a30-aa6a-02759a154377 None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:49.235990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354616a-247d-4a30-aa6a-02759a154377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:49.237400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354616a-247d-4a30-aa6a-02759a154377 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:49.246882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 199/391] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:49.252507 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389009-b89c-451c-bd56-24be6f5dbdc4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:49.299549 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef75b-a4ed-435c-8e02-62ecb90031cd None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.299839 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef75b-a4ed-435c-8e02-62ecb90031cd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.300117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef75b-a4ed-435c-8e02-62ecb90031cd None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.301767 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 200/392] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:49.306854 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be742-72dc-4295-b411-3b9ca24f4249 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.307139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be742-72dc-4295-b411-3b9ca24f4249 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.307418 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be742-72dc-4295-b411-3b9ca24f4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.344392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fc7be742-72dc-4295-b411-3b9ca24f4249 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:49.345637 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fc7be742-72dc-4295-b411-3b9ca24f4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:49.353044 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:49.416467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389009-b89c-451c-bd56-24be6f5dbdc4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:49.443977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:49.486685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 201/393] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:49.487803 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fa21c-653e-4a70-a13e-693976553843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:49.488448 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa21c-653e-4a70-a13e-693976553843 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.488756 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa21c-653e-4a70-a13e-693976553843 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.489026 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa21c-653e-4a70-a13e-693976553843 None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.490164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fa21c-653e-4a70-a13e-693976553843 None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:49.491604 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fa21c-653e-4a70-a13e-693976553843 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:49.493465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 193/394] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:49 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:49.499069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7be742-72dc-4295-b411-3b9ca24f4249 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:49.629059 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c9c6-a249-4e0d-a70c-1e71f39acf7b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.629388 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c9c6-a249-4e0d-a70c-1e71f39acf7b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.629620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c9c6-a249-4e0d-a70c-1e71f39acf7b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.630954 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 194/395] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:49.636155 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ba07-ca92-4569-ac29-14eb965a274f None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.636434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ba07-ca92-4569-ac29-14eb965a274f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.636736 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ba07-ca92-4569-ac29-14eb965a274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.655538 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-d033ba07-ca92-4569-ac29-14eb965a274f None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:49.656794 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-d033ba07-ca92-4569-ac29-14eb965a274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:49.672431 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7be742-72dc-4295-b411-3b9ca24f4249 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:49.745500 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5843e5-9857-4c99-850a-29cb4d2a3d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:49.745701 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 195/396] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:49.746668 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5843e5-9857-4c99-850a-29cb4d2a3d8c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.747092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5843e5-9857-4c99-850a-29cb4d2a3d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.747491 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5843e5-9857-4c99-850a-29cb4d2a3d8c None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.748972 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5843e5-9857-4c99-850a-29cb4d2a3d8c None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:49.751159 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5843e5-9857-4c99-850a-29cb4d2a3d8c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:49.753263 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 202/397] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:49 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:49.759246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033ba07-ca92-4569-ac29-14eb965a274f None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:49.854220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:49.921400 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033ba07-ca92-4569-ac29-14eb965a274f None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:49.976008 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81477ee8-6645-4f01-93d8-1935491e198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:49.977486 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477ee8-6645-4f01-93d8-1935491e198f None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.978248 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477ee8-6645-4f01-93d8-1935491e198f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.978721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477ee8-6645-4f01-93d8-1935491e198f None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/groups/5887f8016e20478b91a75ef389f669cc/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.980888 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81477ee8-6645-4f01-93d8-1935491e198f None admin] RBAC: Authorizing `identity:create_grant(project_id=025a96e9ed2b499596ba4f54f4b8ab08, group_id=5887f8016e20478b91a75ef389f669cc, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:49.982555 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81477ee8-6645-4f01-93d8-1935491e198f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:50.008194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 196/398] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 09:52:49 2022] PUT /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08/groups/5887f8016e20478b91a75ef389f669cc/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:50.078446 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5843e5-9857-4c99-850a-29cb4d2a3d8c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:50.139096 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:50.166065 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81477ee8-6645-4f01-93d8-1935491e198f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:50.202982 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5843e5-9857-4c99-850a-29cb4d2a3d8c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:50.247323 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaa3a-0beb-4ff8-989e-08939086fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:50.248261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaa3a-0beb-4ff8-989e-08939086fa56 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:50.248715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaa3a-0beb-4ff8-989e-08939086fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:50.249179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaa3a-0beb-4ff8-989e-08939086fa56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:50.261311 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaaa3a-0beb-4ff8-989e-08939086fa56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-ccfaaa3a-0beb-4ff8-989e-08939086fa56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:50.266857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:50.267788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:50.268605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:50.271301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 203/399] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:50.277015 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaa3a-0beb-4ff8-989e-08939086fa56 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:50.316541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81477ee8-6645-4f01-93d8-1935491e198f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:50.335550 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:50.381341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf6fc-5e6c-4d9e-8a0d-7409c2661c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:50.382014 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf6fc-5e6c-4d9e-8a0d-7409c2661c27 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:50.382298 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf6fc-5e6c-4d9e-8a0d-7409c2661c27 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:50.382574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf6fc-5e6c-4d9e-8a0d-7409c2661c27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:50.408810 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddf6fc-5e6c-4d9e-8a0d-7409c2661c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-72ddf6fc-5e6c-4d9e-8a0d-7409c2661c27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:50.413661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:50.414600 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:50.415421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:50.422810 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 197/400] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:50.423747 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf6fc-5e6c-4d9e-8a0d-7409c2661c27 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:50.452163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaa3a-0beb-4ff8-989e-08939086fa56 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:50.477719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:50.523983 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518701-4c6d-49d9-8f19-e2c3e81f5b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:50.524524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518701-4c6d-49d9-8f19-e2c3e81f5b2c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:50.524831 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518701-4c6d-49d9-8f19-e2c3e81f5b2c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:50.525112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518701-4c6d-49d9-8f19-e2c3e81f5b2c None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:50.525913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518701-4c6d-49d9-8f19-e2c3e81f5b2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:50.526221 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518701-4c6d-49d9-8f19-e2c3e81f5b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:50.527609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518701-4c6d-49d9-8f19-e2c3e81f5b2c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:50.537758 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 204/401] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:50.539135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c6272-1c7c-4751-a16d-6d866f00abe9 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:50.539428 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c6272-1c7c-4751-a16d-6d866f00abe9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:50.539707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c6272-1c7c-4751-a16d-6d866f00abe9 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:50.541344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 205/402] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:50.545496 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c6272-1c7c-4751-a16d-6d866f00abe9 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:50.601151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf6fc-5e6c-4d9e-8a0d-7409c2661c27 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:50.637809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf834b-50e3-4535-a64a-b96e67f576b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:50.638714 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf834b-50e3-4535-a64a-b96e67f576b3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:50.639168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf834b-50e3-4535-a64a-b96e67f576b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:50.639612 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf834b-50e3-4535-a64a-b96e67f576b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:50.641019 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf834b-50e3-4535-a64a-b96e67f576b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:50.641496 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf834b-50e3-4535-a64a-b96e67f576b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:50.643102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf834b-50e3-4535-a64a-b96e67f576b3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:50.658402 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 198/403] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:50.659900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a86c-26ea-48a5-a594-7fd7481300d4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:50.660268 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a86c-26ea-48a5-a594-7fd7481300d4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:50.660872 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a86c-26ea-48a5-a594-7fd7481300d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:50.682416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c6272-1c7c-4751-a16d-6d866f00abe9 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:50.684741 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6b31a86c-26ea-48a5-a594-7fd7481300d4 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:50.686937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6b31a86c-26ea-48a5-a594-7fd7481300d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:50.729307 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5a71-80a8-401b-9a3a-40ed1b7541b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:50.730129 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5a71-80a8-401b-9a3a-40ed1b7541b3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:50.730503 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5a71-80a8-401b-9a3a-40ed1b7541b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:50.730828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae5a71-80a8-401b-9a3a-40ed1b7541b3 None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:50.732126 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae5a71-80a8-401b-9a3a-40ed1b7541b3 None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:50.733019 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:50.736817 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae5a71-80a8-401b-9a3a-40ed1b7541b3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:50.743286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 206/404] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:50 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:50.743286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5a71-80a8-401b-9a3a-40ed1b7541b3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:50.776231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 199/405] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:50.777423 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31a86c-26ea-48a5-a594-7fd7481300d4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:50.804591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:50.933629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae5a71-80a8-401b-9a3a-40ed1b7541b3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:50.957226 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31a86c-26ea-48a5-a594-7fd7481300d4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:50.976705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9935d38-7382-4a2a-be54-08d04f385ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:50.977830 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935d38-7382-4a2a-be54-08d04f385ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:50.978369 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935d38-7382-4a2a-be54-08d04f385ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:50.979032 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935d38-7382-4a2a-be54-08d04f385ae2 None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:50.980501 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9935d38-7382-4a2a-be54-08d04f385ae2 None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:50.982467 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9935d38-7382-4a2a-be54-08d04f385ae2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:50.984956 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 207/406] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:50 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:50.994100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9935d38-7382-4a2a-be54-08d04f385ae2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:51.003491 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad05ec5-7ebc-47aa-a161-76c66bc74fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:51.004133 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05ec5-7ebc-47aa-a161-76c66bc74fc9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.005560 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05ec5-7ebc-47aa-a161-76c66bc74fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.005560 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05ec5-7ebc-47aa-a161-76c66bc74fc9 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.009520 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad05ec5-7ebc-47aa-a161-76c66bc74fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:51.011299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad05ec5-7ebc-47aa-a161-76c66bc74fc9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:51.013285 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 200/407] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:50 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:51.025921 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad05ec5-7ebc-47aa-a161-76c66bc74fc9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:51.128187 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:51.132951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9935d38-7382-4a2a-be54-08d04f385ae2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:51.143031 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:51.175411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86369ad-e0b2-4a61-bc53-ea07d06c58fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:51.176054 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86369ad-e0b2-4a61-bc53-ea07d06c58fb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.176335 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86369ad-e0b2-4a61-bc53-ea07d06c58fb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.176609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86369ad-e0b2-4a61-bc53-ea07d06c58fb None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.177778 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86369ad-e0b2-4a61-bc53-ea07d06c58fb None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:51.179210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86369ad-e0b2-4a61-bc53-ea07d06c58fb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:51.181251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 208/408] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:50 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:51.189553 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86369ad-e0b2-4a61-bc53-ea07d06c58fb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:51.229256 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad05ec5-7ebc-47aa-a161-76c66bc74fc9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:51.266579 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea1910-2444-4f34-900f-3779fc0fed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:51.267252 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1910-2444-4f34-900f-3779fc0fed3d None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.267534 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1910-2444-4f34-900f-3779fc0fed3d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.267807 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1910-2444-4f34-900f-3779fc0fed3d None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/groups/5887f8016e20478b91a75ef389f669cc/roles/c4c1742a54eb440c9d94f137cb668187` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.270036 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea1910-2444-4f34-900f-3779fc0fed3d None admin] RBAC: Authorizing `identity:create_grant(project_id=d6e695e9bbce46bfbf76400d173ba8ae, group_id=5887f8016e20478b91a75ef389f669cc, role_id=c4c1742a54eb440c9d94f137cb668187)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:51.271478 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea1910-2444-4f34-900f-3779fc0fed3d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:51.288262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 201/409] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 09:52:51 2022] PUT /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/groups/5887f8016e20478b91a75ef389f669cc/roles/c4c1742a54eb440c9d94f137cb668187 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:52:51.289418 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea1910-2444-4f34-900f-3779fc0fed3d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:51.359159 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86369ad-e0b2-4a61-bc53-ea07d06c58fb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:51.425426 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:51.430680 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea1910-2444-4f34-900f-3779fc0fed3d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:51.456578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f857b-71b6-4180-ab2d-05ea1a10d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:51.457280 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f857b-71b6-4180-ab2d-05ea1a10d3d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.457558 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f857b-71b6-4180-ab2d-05ea1a10d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.457831 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f857b-71b6-4180-ab2d-05ea1a10d3d9 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/groups/5887f8016e20478b91a75ef389f669cc/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.459771 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f857b-71b6-4180-ab2d-05ea1a10d3d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6e695e9bbce46bfbf76400d173ba8ae, group_id=5887f8016e20478b91a75ef389f669cc, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:51.461247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f857b-71b6-4180-ab2d-05ea1a10d3d9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:51.478182 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5962c87-da05-42f1-ac92-ef35eb246e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:51.479383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5962c87-da05-42f1-ac92-ef35eb246e6b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.479762 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5962c87-da05-42f1-ac92-ef35eb246e6b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.480193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5962c87-da05-42f1-ac92-ef35eb246e6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.490821 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 209/410] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 09:52:51 2022] PUT /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae/groups/5887f8016e20478b91a75ef389f669cc/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:51.500523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5962c87-da05-42f1-ac92-ef35eb246e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a5962c87-da05-42f1-ac92-ef35eb246e6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:51.510436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:51.511428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:51.512366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 202/411] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:52:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:51.520049 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f857b-71b6-4180-ab2d-05ea1a10d3d9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:51.567082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:51.599970 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261baf-77d9-4c3a-ae95-8d0024118b24 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.600381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261baf-77d9-4c3a-ae95-8d0024118b24 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.600521 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261baf-77d9-4c3a-ae95-8d0024118b24 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.602697 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 203/412] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:51.608260 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff18de-b2e7-41b3-a105-053d720a707b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.608554 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff18de-b2e7-41b3-a105-053d720a707b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.608858 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff18de-b2e7-41b3-a105-053d720a707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.634610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-29ff18de-b2e7-41b3-a105-053d720a707b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:51.636097 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-29ff18de-b2e7-41b3-a105-053d720a707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:51.652165 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f857b-71b6-4180-ab2d-05ea1a10d3d9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:51.699267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:51.701011 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.701287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.701556 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.702252 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:51.702547 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:51.704025 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:51.720532 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 210/413] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:51.729766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:51.749483 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 204/414] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:51.849115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:51.864941 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53970-ae4d-4306-a14f-c9b60f70cd07 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:51.931613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426290-6f83-44cc-89cc-c38a56ba44d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:51.932639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426290-6f83-44cc-89cc-c38a56ba44d0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:51.933158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426290-6f83-44cc-89cc-c38a56ba44d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:51.933682 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426290-6f83-44cc-89cc-c38a56ba44d0 None admin] PATH_INFO: `/v3/groups/2b3cd017980d4922b0da1c70b02e0d11` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:51.935021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45426290-6f83-44cc-89cc-c38a56ba44d0 None admin] RBAC: Authorizing `identity:get_group(group_id=2b3cd017980d4922b0da1c70b02e0d11)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:51.936751 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45426290-6f83-44cc-89cc-c38a56ba44d0 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:51.939005 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 211/415] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:51 2022] GET /identity/v3/groups/2b3cd017980d4922b0da1c70b02e0d11 => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:51.945751 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff18de-b2e7-41b3-a105-053d720a707b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:52.078299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:52.092556 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff18de-b2e7-41b3-a105-053d720a707b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:52.095276 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426290-6f83-44cc-89cc-c38a56ba44d0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:52.145760 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83501afe-3092-4123-81df-ad6337330f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:52.146405 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83501afe-3092-4123-81df-ad6337330f67 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:52.146682 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83501afe-3092-4123-81df-ad6337330f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:52.146949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83501afe-3092-4123-81df-ad6337330f67 None admin] PATH_INFO: `/v3/projects/928770adba0b40bd87bea18febe221ea` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:52.150105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83501afe-3092-4123-81df-ad6337330f67 None admin] RBAC: Authorizing `identity:get_project(project_id=928770adba0b40bd87bea18febe221ea)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:52.151537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83501afe-3092-4123-81df-ad6337330f67 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:52.160350 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 205/416] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:51 2022] GET /identity/v3/projects/928770adba0b40bd87bea18febe221ea => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:52.165726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83501afe-3092-4123-81df-ad6337330f67 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:52.233322 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426290-6f83-44cc-89cc-c38a56ba44d0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:52.272371 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fc4d-1c35-4cfa-9b46-b4c1e1cb7f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:52.273403 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fc4d-1c35-4cfa-9b46-b4c1e1cb7f60 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:52.273880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fc4d-1c35-4cfa-9b46-b4c1e1cb7f60 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:52.274346 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06fc4d-1c35-4cfa-9b46-b4c1e1cb7f60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:52.286208 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06fc4d-1c35-4cfa-9b46-b4c1e1cb7f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-3d06fc4d-1c35-4cfa-9b46-b4c1e1cb7f60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:52.291785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:52.292717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:52.293557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:52.296130 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 212/417] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:52.302224 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fc4d-1c35-4cfa-9b46-b4c1e1cb7f60 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:52.331930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:52.399201 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83501afe-3092-4123-81df-ad6337330f67 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:52.464828 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf4e3c-5f84-4f7c-9e73-b5fb98dacc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:52.465492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf4e3c-5f84-4f7c-9e73-b5fb98dacc36 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:52.465777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf4e3c-5f84-4f7c-9e73-b5fb98dacc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:52.466052 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf4e3c-5f84-4f7c-9e73-b5fb98dacc36 None admin] PATH_INFO: `/v3/projects/928770adba0b40bd87bea18febe221ea/groups/2b3cd017980d4922b0da1c70b02e0d11/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:52.469688 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf4e3c-5f84-4f7c-9e73-b5fb98dacc36 None admin] RBAC: Authorizing `identity:create_grant(project_id=928770adba0b40bd87bea18febe221ea, group_id=2b3cd017980d4922b0da1c70b02e0d11, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:52.471147 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf4e3c-5f84-4f7c-9e73-b5fb98dacc36 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:52.482884 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06fc4d-1c35-4cfa-9b46-b4c1e1cb7f60 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:52.501833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 206/418] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 24 09:52:52 2022] PUT /identity/v3/projects/928770adba0b40bd87bea18febe221ea/groups/2b3cd017980d4922b0da1c70b02e0d11/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:52.527850 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae410ae-d309-42ad-a01d-536f708c426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:52.528490 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae410ae-d309-42ad-a01d-536f708c426d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:52.528801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae410ae-d309-42ad-a01d-536f708c426d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:52.529076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae410ae-d309-42ad-a01d-536f708c426d None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:52.529824 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae410ae-d309-42ad-a01d-536f708c426d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:52.530132 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae410ae-d309-42ad-a01d-536f708c426d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:52.532863 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae410ae-d309-42ad-a01d-536f708c426d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:52.547287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 213/419] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:52.548559 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf4e3c-5f84-4f7c-9e73-b5fb98dacc36 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:52.582159 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:52.694990 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf4e3c-5f84-4f7c-9e73-b5fb98dacc36 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:52.736089 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0f929-bb05-414f-a9b4-903027109414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:52.736746 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f929-bb05-414f-a9b4-903027109414 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:52.737035 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f929-bb05-414f-a9b4-903027109414 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:52.737310 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f929-bb05-414f-a9b4-903027109414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:52.816937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0f929-bb05-414f-a9b4-903027109414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:52.818436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0f929-bb05-414f-a9b4-903027109414 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:52.826424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6d9bf-5cda-4fd7-92e4-fc22747cb43c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:52.826733 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6d9bf-5cda-4fd7-92e4-fc22747cb43c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:52.826995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6d9bf-5cda-4fd7-92e4-fc22747cb43c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:52.832426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 214/420] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:52.835318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648973-5c96-4ae5-989b-ef80ae17df93 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:52.835607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648973-5c96-4ae5-989b-ef80ae17df93 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:52.835885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648973-5c96-4ae5-989b-ef80ae17df93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:52.845951 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:52.858119 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-6b648973-5c96-4ae5-989b-ef80ae17df93 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:52.859379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-6b648973-5c96-4ae5-989b-ef80ae17df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:52.945808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 215/421] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:52.952738 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 207/422] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:52.960865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648973-5c96-4ae5-989b-ef80ae17df93 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:52.981379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:53.082361 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648973-5c96-4ae5-989b-ef80ae17df93 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:53.130603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a127-182d-40a0-b918-0d654af3e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:53.131169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a127-182d-40a0-b918-0d654af3e91b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:53.131452 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a127-182d-40a0-b918-0d654af3e91b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:53.131728 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722a127-182d-40a0-b918-0d654af3e91b None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:53.137436 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722a127-182d-40a0-b918-0d654af3e91b None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:53.138910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722a127-182d-40a0-b918-0d654af3e91b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:53.141130 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 216/423] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:52 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:53.146775 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0f929-bb05-414f-a9b4-903027109414 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:53.254004 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0f929-bb05-414f-a9b4-903027109414 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:53.276037 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:53.297185 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b7c04-cf74-4648-9c78-c04624af0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:53.297830 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7c04-cf74-4648-9c78-c04624af0532 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:53.298114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7c04-cf74-4648-9c78-c04624af0532 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:53.298390 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7c04-cf74-4648-9c78-c04624af0532 None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:53.299526 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b7c04-cf74-4648-9c78-c04624af0532 None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:53.301043 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b7c04-cf74-4648-9c78-c04624af0532 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:53.307779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 208/424] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:53 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:53.309248 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a127-182d-40a0-b918-0d654af3e91b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:53.402451 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:53.415278 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b7c04-cf74-4648-9c78-c04624af0532 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:53.423922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722a127-182d-40a0-b918-0d654af3e91b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:53.476997 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:53.477621 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:53.478027 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:53.478310 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:53.479047 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] RBAC: Adding query filter params (group.id=5887f8016e20478b91a75ef389f669cc, role.id=c4c1742a54eb440c9d94f137cb668187, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:53.479355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:53.480828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:53.492584 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 217/425] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:53 2022] GET /identity/v3/role_assignments?group.id=5887f8016e20478b91a75ef389f669cc&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=c4c1742a54eb440c9d94f137cb668187 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:53.569386 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b7c04-cf74-4648-9c78-c04624af0532 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:53.626269 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abbfc2-326d-4b6d-8e02-8fd79aa4ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:53.626929 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abbfc2-326d-4b6d-8e02-8fd79aa4ab80 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:53.627212 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abbfc2-326d-4b6d-8e02-8fd79aa4ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:53.627541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abbfc2-326d-4b6d-8e02-8fd79aa4ab80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:53.647428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abbfc2-326d-4b6d-8e02-8fd79aa4ab80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-30abbfc2-326d-4b6d-8e02-8fd79aa4ab80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:53.652577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:53.653525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:53.654348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:53.658926 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 209/426] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:53.661990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:53.815890 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3e63-47a9-4446-b63f-b250ee1e6708 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:53.854500 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a0288-ed9c-4de6-b88b-5ac413d3615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:53.855112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0288-ed9c-4de6-b88b-5ac413d3615f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:53.855388 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0288-ed9c-4de6-b88b-5ac413d3615f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:53.855652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0288-ed9c-4de6-b88b-5ac413d3615f None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:53.856313 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a0288-ed9c-4de6-b88b-5ac413d3615f None admin] RBAC: Adding query filter params (name=member) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:53.856609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a0288-ed9c-4de6-b88b-5ac413d3615f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:53.858064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a0288-ed9c-4de6-b88b-5ac413d3615f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:53.867127 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 218/427] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:53.872541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abbfc2-326d-4b6d-8e02-8fd79aa4ab80 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:53.943140 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:54.009545 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abbfc2-326d-4b6d-8e02-8fd79aa4ab80 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:54.045749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e131be-4d43-4f7f-8abc-718cd2af3b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:54.046440 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e131be-4d43-4f7f-8abc-718cd2af3b62 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.046729 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e131be-4d43-4f7f-8abc-718cd2af3b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.047004 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e131be-4d43-4f7f-8abc-718cd2af3b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.128700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e131be-4d43-4f7f-8abc-718cd2af3b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:54.130276 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e131be-4d43-4f7f-8abc-718cd2af3b62 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:54.191684 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:54.254510 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536988f-49e6-4404-9f65-e47c670d3fee None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.254837 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536988f-49e6-4404-9f65-e47c670d3fee None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.255075 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536988f-49e6-4404-9f65-e47c670d3fee None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.256688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 219/428] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:54.261799 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c9c9-eb36-4dbd-8f68-a5e06a595099 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.262089 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c9c9-eb36-4dbd-8f68-a5e06a595099 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.262367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c9c9-eb36-4dbd-8f68-a5e06a595099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.281606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-d933c9c9-eb36-4dbd-8f68-a5e06a595099 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:54.282828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-d933c9c9-eb36-4dbd-8f68-a5e06a595099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:54.293043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:54.293443 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 210/429] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:54.299187 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e131be-4d43-4f7f-8abc-718cd2af3b62 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:54.366360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 220/430] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:54.367876 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5435-c2f7-4695-9249-42fd52825d0b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.368161 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5435-c2f7-4695-9249-42fd52825d0b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.368430 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f5435-c2f7-4695-9249-42fd52825d0b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.369718 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 221/431] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:54.375752 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475f47-7fc3-45bd-b5ee-bbf07aaef33d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.376031 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475f47-7fc3-45bd-b5ee-bbf07aaef33d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.376306 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475f47-7fc3-45bd-b5ee-bbf07aaef33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.395212 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-38475f47-7fc3-45bd-b5ee-bbf07aaef33d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:54.396404 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-38475f47-7fc3-45bd-b5ee-bbf07aaef33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:54.427237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e131be-4d43-4f7f-8abc-718cd2af3b62 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:54.466580 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f123d-4690-4866-8d36-7f03988c858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:54.467192 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f123d-4690-4866-8d36-7f03988c858f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.467525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f123d-4690-4866-8d36-7f03988c858f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.468043 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f123d-4690-4866-8d36-7f03988c858f None admin] PATH_INFO: `/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.469491 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f123d-4690-4866-8d36-7f03988c858f None admin] RBAC: Authorizing `identity:get_project(project_id=025a96e9ed2b499596ba4f54f4b8ab08)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:54.470938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f123d-4690-4866-8d36-7f03988c858f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:54.472996 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 211/432] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:54 2022] GET /identity/v3/projects/025a96e9ed2b499596ba4f54f4b8ab08 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:54.477769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 222/433] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:52:54.481810 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f123d-4690-4866-8d36-7f03988c858f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:54.499590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:54.607866 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f123d-4690-4866-8d36-7f03988c858f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:54.644964 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771d2c-edc3-402e-9f4a-250d0bb2bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:54.645601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771d2c-edc3-402e-9f4a-250d0bb2bdef None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.645878 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771d2c-edc3-402e-9f4a-250d0bb2bdef None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.646151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771d2c-edc3-402e-9f4a-250d0bb2bdef None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.647339 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771d2c-edc3-402e-9f4a-250d0bb2bdef None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:54.648795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771d2c-edc3-402e-9f4a-250d0bb2bdef None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:54.650668 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 212/434] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:54 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:54.659935 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475f47-7fc3-45bd-b5ee-bbf07aaef33d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:54.708879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771d2c-edc3-402e-9f4a-250d0bb2bdef None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:54.751963 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:54.793506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475f47-7fc3-45bd-b5ee-bbf07aaef33d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:54.829387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:54.838384 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:54.839331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.839806 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.840223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.842308 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] RBAC: Adding query filter params (group.id=5887f8016e20478b91a75ef389f669cc, role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:54.842308 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:54.844801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:54.860694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771d2c-edc3-402e-9f4a-250d0bb2bdef None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:54.861050 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 223/435] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:54 2022] GET /identity/v3/role_assignments?group.id=5887f8016e20478b91a75ef389f669cc&scope.project.id=025a96e9ed2b499596ba4f54f4b8ab08&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:54.887046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:54.899260 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffead-32d0-483e-b2fa-044dc98fcbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:54.900017 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffead-32d0-483e-b2fa-044dc98fcbfb None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:54.900378 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffead-32d0-483e-b2fa-044dc98fcbfb None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:54.900837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffead-32d0-483e-b2fa-044dc98fcbfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:54.918794 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ffead-32d0-483e-b2fa-044dc98fcbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-8c5ffead-32d0-483e-b2fa-044dc98fcbfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:54.924585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:54.925620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:52:54.926445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:52:54.931100 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 213/436] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:52:54.932339 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffead-32d0-483e-b2fa-044dc98fcbfb None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:55.036945 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbb6b9-da16-4cf0-a89d-985beb8572fe None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.055022 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffead-32d0-483e-b2fa-044dc98fcbfb None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.081052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b23ce-5a9a-46bb-a710-afe5ea22a9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:55.081701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b23ce-5a9a-46bb-a710-afe5ea22a9ca None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.081984 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b23ce-5a9a-46bb-a710-afe5ea22a9ca None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.082266 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b23ce-5a9a-46bb-a710-afe5ea22a9ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.085853 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.100991 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b23ce-5a9a-46bb-a710-afe5ea22a9ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:55.104711 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:55.105538 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.105929 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.106311 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-502b23ce-5a9a-46bb-a710-afe5ea22a9ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:55.107744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:55.108940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:52:55.110554 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:55.111186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] RBAC: Adding query filter params (name=member) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:55.111186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:55.111311 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 224/437] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:52:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:55.111376 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:55.118382 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b23ce-5a9a-46bb-a710-afe5ea22a9ca None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:55.123597 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 214/438] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:52:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:55.130846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:55.135383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.273125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b23ce-5a9a-46bb-a710-afe5ea22a9ca None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.276407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bea03e-d023-49e3-a684-64f2abc9e95d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.319239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe94d5-66dc-429b-8336-f2f7c7e9cf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:55.319239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe94d5-66dc-429b-8336-f2f7c7e9cf2e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.319239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe94d5-66dc-429b-8336-f2f7c7e9cf2e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.319620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe94d5-66dc-429b-8336-f2f7c7e9cf2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.321832 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6367f26-6dfb-4ca7-8996-23eec8a51465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:55.322622 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6367f26-6dfb-4ca7-8996-23eec8a51465 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.322896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6367f26-6dfb-4ca7-8996-23eec8a51465 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.323164 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6367f26-6dfb-4ca7-8996-23eec8a51465 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.324084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6367f26-6dfb-4ca7-8996-23eec8a51465 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:55.325440 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6367f26-6dfb-4ca7-8996-23eec8a51465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:55.326154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6367f26-6dfb-4ca7-8996-23eec8a51465 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:55.335263 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 225/439] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:52:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:55.336569 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfcbdc-6c6d-4e75-9a56-261b5c6064c4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.336899 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfcbdc-6c6d-4e75-9a56-261b5c6064c4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.337154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfcbdc-6c6d-4e75-9a56-261b5c6064c4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.338369 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 226/440] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:55.345705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32f68-45ed-4cd9-b9bc-8beae7d5b10d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.345978 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32f68-45ed-4cd9-b9bc-8beae7d5b10d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.346251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32f68-45ed-4cd9-b9bc-8beae7d5b10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.366827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-16f32f68-45ed-4cd9-b9bc-8beae7d5b10d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:55.368698 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-16f32f68-45ed-4cd9-b9bc-8beae7d5b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:55.404276 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe94d5-66dc-429b-8336-f2f7c7e9cf2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:55.405822 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe94d5-66dc-429b-8336-f2f7c7e9cf2e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:55.409167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.435782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.464977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 227/441] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:55.466099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32f68-45ed-4cd9-b9bc-8beae7d5b10d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:55.551316 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 215/442] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:55.557297 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe94d5-66dc-429b-8336-f2f7c7e9cf2e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:55.608411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32f68-45ed-4cd9-b9bc-8beae7d5b10d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.645987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8045940-0c6f-4a5b-87c8-4936d1377c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:55.646594 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045940-0c6f-4a5b-87c8-4936d1377c52 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.646909 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045940-0c6f-4a5b-87c8-4936d1377c52 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.647139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045940-0c6f-4a5b-87c8-4936d1377c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.667265 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe94d5-66dc-429b-8336-f2f7c7e9cf2e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.668959 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.705467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef5c27-34f6-47df-bce7-bbe25f35899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:55.706161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef5c27-34f6-47df-bce7-bbe25f35899c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.706290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.706451 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef5c27-34f6-47df-bce7-bbe25f35899c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.706730 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef5c27-34f6-47df-bce7-bbe25f35899c None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.707935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef5c27-34f6-47df-bce7-bbe25f35899c None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:55.709499 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef5c27-34f6-47df-bce7-bbe25f35899c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:55.711165 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 216/443] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:55 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:55.716520 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef5c27-34f6-47df-bce7-bbe25f35899c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:55.725954 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8045940-0c6f-4a5b-87c8-4936d1377c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:55.727430 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8045940-0c6f-4a5b-87c8-4936d1377c52 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:55.825153 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef5c27-34f6-47df-bce7-bbe25f35899c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.837324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 228/444] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:55.838234 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8045940-0c6f-4a5b-87c8-4936d1377c52 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:55.866496 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd10a0-d8d3-4881-9ce1-301433163144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:55.867041 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd10a0-d8d3-4881-9ce1-301433163144 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.867320 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd10a0-d8d3-4881-9ce1-301433163144 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.867598 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd10a0-d8d3-4881-9ce1-301433163144 None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.868757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd10a0-d8d3-4881-9ce1-301433163144 None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:55.870204 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd10a0-d8d3-4881-9ce1-301433163144 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:55.871774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 217/445] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:55 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:55.872536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd10a0-d8d3-4881-9ce1-301433163144 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:55.917343 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.925968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.941190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8045940-0c6f-4a5b-87c8-4936d1377c52 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.976125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3efe-f0a3-469d-90a5-5a7fcb5a65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:55.976779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3efe-f0a3-469d-90a5-5a7fcb5a65e0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.977063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3efe-f0a3-469d-90a5-5a7fcb5a65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.977153 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd10a0-d8d3-4881-9ce1-301433163144 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:55.977338 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3efe-f0a3-469d-90a5-5a7fcb5a65e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.987249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e3efe-f0a3-469d-90a5-5a7fcb5a65e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e06e3efe-f0a3-469d-90a5-5a7fcb5a65e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:52:55.991936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:52:55.992859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:52:55.993706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 229/446] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:52:55.994376 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3efe-f0a3-469d-90a5-5a7fcb5a65e0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:56.015009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adee722-39ac-4b7f-8cb8-9eaa89e1c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:56.016152 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee722-39ac-4b7f-8cb8-9eaa89e1c3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:56.016429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee722-39ac-4b7f-8cb8-9eaa89e1c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:56.016735 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee722-39ac-4b7f-8cb8-9eaa89e1c3a7 None admin] PATH_INFO: `/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:56.017884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adee722-39ac-4b7f-8cb8-9eaa89e1c3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=d6e695e9bbce46bfbf76400d173ba8ae)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:56.019325 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adee722-39ac-4b7f-8cb8-9eaa89e1c3a7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:56.021157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 218/447] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:55 2022] GET /identity/v3/projects/d6e695e9bbce46bfbf76400d173ba8ae => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:56.021766 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adee722-39ac-4b7f-8cb8-9eaa89e1c3a7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:56.096611 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3efe-f0a3-469d-90a5-5a7fcb5a65e0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:56.123444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adee722-39ac-4b7f-8cb8-9eaa89e1c3a7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:56.130974 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:56.131566 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:56.132171 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:56.132450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:56.132782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:56.133530 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] RBAC: Adding query filter params (group.id=5887f8016e20478b91a75ef389f669cc, role.id=74f67ab31fb74494b29826e8e6fd77cc, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:56.133838 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:56.135271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:56.141579 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 230/448] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:55 2022] GET /identity/v3/role_assignments?group.id=5887f8016e20478b91a75ef389f669cc&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=74f67ab31fb74494b29826e8e6fd77cc => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:56.142607 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:56.159699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:56.160326 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:56.160611 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:56.160961 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:56.161625 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:56.161931 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:56.163328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:56.171334 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:56.178373 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 219/449] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:56.179877 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:56.277294 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb875f-c995-4c8f-bc09-3eba34293514 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:56.294812 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5e55b-1913-429f-b6e8-7f16844e53d4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:56.320032 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d530d-793d-48d1-8807-ffac764f93aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:56.320692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d530d-793d-48d1-8807-ffac764f93aa None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:56.320987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d530d-793d-48d1-8807-ffac764f93aa None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:56.321259 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d530d-793d-48d1-8807-ffac764f93aa None admin] PATH_INFO: `/v3/groups/5887f8016e20478b91a75ef389f669cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:56.322424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d530d-793d-48d1-8807-ffac764f93aa None admin] RBAC: Authorizing `identity:get_group(group_id=5887f8016e20478b91a75ef389f669cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:56.323939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d530d-793d-48d1-8807-ffac764f93aa None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:56.325722 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 231/450] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:56 2022] GET /identity/v3/groups/5887f8016e20478b91a75ef389f669cc => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:56.332445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d530d-793d-48d1-8807-ffac764f93aa None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:56.337554 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89aa8a-d046-4eff-8631-94a00ab9b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:56.338177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aa8a-d046-4eff-8631-94a00ab9b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:56.338459 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aa8a-d046-4eff-8631-94a00ab9b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:56.338736 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aa8a-d046-4eff-8631-94a00ab9b9c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:56.383325 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:56.423136 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89aa8a-d046-4eff-8631-94a00ab9b9c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:56.424638 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89aa8a-d046-4eff-8631-94a00ab9b9c5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:56.435356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:56.467381 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d530d-793d-48d1-8807-ffac764f93aa None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:56.510424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:56.510714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:56.510991 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:56.511261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:56.511993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] RBAC: Adding query filter params (group.id=5887f8016e20478b91a75ef389f669cc, role.id=c4c1742a54eb440c9d94f137cb668187, scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:56.512297 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:56.514267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:56.521372 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 232/451] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:56 2022] GET /identity/v3/role_assignments?group.id=5887f8016e20478b91a75ef389f669cc&scope.project.id=d6e695e9bbce46bfbf76400d173ba8ae&role.id=c4c1742a54eb440c9d94f137cb668187 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:56.553436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 220/452] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:52:56.559637 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:56.670788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57426c-fd8e-4189-ac56-88b26d2f866e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:56.706883 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ec7ae-dc8d-4e2c-8393-26335a557f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:56.707513 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ec7ae-dc8d-4e2c-8393-26335a557f40 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:56.707795 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ec7ae-dc8d-4e2c-8393-26335a557f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:56.708070 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ec7ae-dc8d-4e2c-8393-26335a557f40 None admin] PATH_INFO: `/v3/projects/928770adba0b40bd87bea18febe221ea` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:56.709225 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ec7ae-dc8d-4e2c-8393-26335a557f40 None admin] RBAC: Authorizing `identity:get_project(project_id=928770adba0b40bd87bea18febe221ea)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:56.710692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ec7ae-dc8d-4e2c-8393-26335a557f40 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:56.712317 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 233/453] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 24 09:52:56 2022] GET /identity/v3/projects/928770adba0b40bd87bea18febe221ea => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:52:56.718391 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89aa8a-d046-4eff-8631-94a00ab9b9c5 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:56.789116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:56.823996 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89aa8a-d046-4eff-8631-94a00ab9b9c5 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:56.861050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc35767-ae24-4216-aa41-055aa93fbda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:56.862429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc35767-ae24-4216-aa41-055aa93fbda5 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:56.862429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc35767-ae24-4216-aa41-055aa93fbda5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:56.862429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc35767-ae24-4216-aa41-055aa93fbda5 None admin] PATH_INFO: `/v3/groups/2b3cd017980d4922b0da1c70b02e0d11` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:56.864009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc35767-ae24-4216-aa41-055aa93fbda5 None admin] RBAC: Authorizing `identity:get_group(group_id=2b3cd017980d4922b0da1c70b02e0d11)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:56.865488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc35767-ae24-4216-aa41-055aa93fbda5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:56.867083 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 221/454] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 24 09:52:56 2022] GET /identity/v3/groups/2b3cd017980d4922b0da1c70b02e0d11 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:56.873026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ec7ae-dc8d-4e2c-8393-26335a557f40 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:56.889024 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:56.980936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ec7ae-dc8d-4e2c-8393-26335a557f40 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:57.016223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181252c-d62d-4ccd-8ab8-a7c305fb86dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:57.016855 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181252c-d62d-4ccd-8ab8-a7c305fb86dd None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:57.017135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181252c-d62d-4ccd-8ab8-a7c305fb86dd None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:57.017405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181252c-d62d-4ccd-8ab8-a7c305fb86dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:57.018125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181252c-d62d-4ccd-8ab8-a7c305fb86dd None admin] RBAC: Adding query filter params (group.id=2b3cd017980d4922b0da1c70b02e0d11, role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=928770adba0b40bd87bea18febe221ea) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:52:57.018433 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181252c-d62d-4ccd-8ab8-a7c305fb86dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:57.019856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181252c-d62d-4ccd-8ab8-a7c305fb86dd None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:57.025842 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 234/455] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 24 09:52:56 2022] GET /identity/v3/role_assignments?group.id=2b3cd017980d4922b0da1c70b02e0d11&scope.project.id=928770adba0b40bd87bea18febe221ea&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:52:59.589875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59a310-072f-4124-8f0b-5b1c2c6f3062 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.590951 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59a310-072f-4124-8f0b-5b1c2c6f3062 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.591454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59a310-072f-4124-8f0b-5b1c2c6f3062 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.593606 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 222/456] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:59.599491 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7f9d-c60d-45de-a1d8-5106277a7d8b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.602298 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7f9d-c60d-45de-a1d8-5106277a7d8b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.602298 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7f9d-c60d-45de-a1d8-5106277a7d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.620347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-557d7f9d-c60d-45de-a1d8-5106277a7d8b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:59.621927 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-557d7f9d-c60d-45de-a1d8-5106277a7d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:59.698728 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 235/457] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:59.817956 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f984e8-e654-47df-ad50-162c3674e9a2 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.818598 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f984e8-e654-47df-ad50-162c3674e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.819098 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f984e8-e654-47df-ad50-162c3674e9a2 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.820992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 223/458] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:59.833773 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39139-447b-44c0-8fb1-4ce7b480c37d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.834064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39139-447b-44c0-8fb1-4ce7b480c37d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.834327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39139-447b-44c0-8fb1-4ce7b480c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.841814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:59.861045 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-05d39139-447b-44c0-8fb1-4ce7b480c37d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:59.862243 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-05d39139-447b-44c0-8fb1-4ce7b480c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:59.929175 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e01e2-6d80-438a-bebc-a978a0962987 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.929454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e01e2-6d80-438a-bebc-a978a0962987 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.929920 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e01e2-6d80-438a-bebc-a978a0962987 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.931226 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 224/459] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:59.936531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3d9d-3fb6-4ff9-b014-135616767554 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.937993 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3d9d-3fb6-4ff9-b014-135616767554 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.938488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3d9d-3fb6-4ff9-b014-135616767554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.944711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 236/460] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:52:59.962345 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-056b3d9d-3fb6-4ff9-b014-135616767554 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:59.963785 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-056b3d9d-3fb6-4ff9-b014-135616767554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:00.038621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 225/461] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:00.051289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d39139-447b-44c0-8fb1-4ce7b480c37d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.162493 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d39139-447b-44c0-8fb1-4ce7b480c37d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:00.198330 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb93a2d-23d1-4de4-9375-771dd9dabf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:00.199219 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93a2d-23d1-4de4-9375-771dd9dabf1e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.199637 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93a2d-23d1-4de4-9375-771dd9dabf1e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.200055 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93a2d-23d1-4de4-9375-771dd9dabf1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.202106 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:00.212507 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb93a2d-23d1-4de4-9375-771dd9dabf1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:00.214212 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb93a2d-23d1-4de4-9375-771dd9dabf1e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-6cb93a2d-23d1-4de4-9375-771dd9dabf1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:00.230012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:00.231229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:00.232344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:00.232344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:00.232344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:00.234153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 237/462] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:00.239778 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3d9d-3fb6-4ff9-b014-135616767554 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.282056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4af06-52e9-4c37-8402-763d52e44426 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.282589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4af06-52e9-4c37-8402-763d52e44426 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.283014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4af06-52e9-4c37-8402-763d52e44426 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.285485 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 238/463] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:00.290534 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d946dd-7d71-4719-9fb6-b253da5677f4 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.291021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d946dd-7d71-4719-9fb6-b253da5677f4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.291443 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d946dd-7d71-4719-9fb6-b253da5677f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.309788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f0d946dd-7d71-4719-9fb6-b253da5677f4 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:00.311019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f0d946dd-7d71-4719-9fb6-b253da5677f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:00.315456 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:00.353759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3d9d-3fb6-4ff9-b014-135616767554 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:00.385125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 239/464] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:00.386205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d946dd-7d71-4719-9fb6-b253da5677f4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.391583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:00.392191 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.392467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.392823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.393556 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:00.393941 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:00.395764 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:00.409041 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 226/465] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:00.410130 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.497384 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d946dd-7d71-4719-9fb6-b253da5677f4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:00.513807 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1616612-f797-4c34-b884-66f0825576b1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:00.517434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:00.537048 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:00.537683 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.538066 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.538334 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.541033 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:00.551097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:00.551286 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:00.551840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.552119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.552553 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.552879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:00.564578 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:00.566063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:00.568216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:00.569156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:00.570092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:00.570092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:00.570092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:00.570092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 240/466] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:00.570319 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:00.587382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:00.588382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:00.589305 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:00.589305 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:00.589305 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:00.589305 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 227/467] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:00.589305 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.687090 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f45da-cef8-444e-bb63-c01e2777426b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:00.697347 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bfd7c-311c-41e3-a867-c5e517c9dd69 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:00.724716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025fc6d-6906-437a-99ec-9b1f2268e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:00.725325 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fc6d-6906-437a-99ec-9b1f2268e84c None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.725604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fc6d-6906-437a-99ec-9b1f2268e84c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.725875 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fc6d-6906-437a-99ec-9b1f2268e84c None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.726503 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025fc6d-6906-437a-99ec-9b1f2268e84c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:00.727933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025fc6d-6906-437a-99ec-9b1f2268e84c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:00.734454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:00.735054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.735332 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.735603 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.736238 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:00.736690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:00.738059 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:00.751897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 228/468] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:00.764754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 241/469] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:53:00 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:00.765179 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.765273 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025fc6d-6906-437a-99ec-9b1f2268e84c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.783634 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:00.816950 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:00.881448 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025fc6d-6906-437a-99ec-9b1f2268e84c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:00.901123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb58860-a728-4486-8b4a-2c3463ab4389 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:00.924955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:00.925609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.926014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.926296 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.939881 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:00.940590 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:00.943888 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:00.944508 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:00.944823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:00.945101 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:00.945771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:00.946074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:00.947491 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:00.958965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:00.959936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:00.960836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:00.960836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:00.960836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:00.960836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 242/470] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:00.961104 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 229/471] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:00.961178 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:00.966480 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:01.052207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:01.082291 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c6fae-a3ce-4a34-8c31-adfd90fde813 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:01.089829 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:01.095476 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a29f-b7d8-4f2a-82af-6e1cacd1993b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:01.122419 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9a21b-cd14-4157-8b05-aff9218731d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:01.123039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9a21b-cd14-4157-8b05-aff9218731d6 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:01.123318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9a21b-cd14-4157-8b05-aff9218731d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:01.123593 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9a21b-cd14-4157-8b05-aff9218731d6 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:01.124235 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9a21b-cd14-4157-8b05-aff9218731d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:01.126247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9a21b-cd14-4157-8b05-aff9218731d6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:01.143522 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:01.144312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:01.144603 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:01.144938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:01.145586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:01.145887 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:01.147304 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:01.161228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 243/472] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:53:00 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:01.161228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9a21b-cd14-4157-8b05-aff9218731d6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:01.168523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 230/473] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:01.174400 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:01.289175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9a21b-cd14-4157-8b05-aff9218731d6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:01.330072 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:01.338252 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffba8d-29c2-4ffc-9d43-316ac3b090ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:01.338957 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ce33a-199a-4f1f-88f5-ef77742e169c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:01.339321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffba8d-29c2-4ffc-9d43-316ac3b090ee None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:01.340063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffba8d-29c2-4ffc-9d43-316ac3b090ee None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:01.340486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffba8d-29c2-4ffc-9d43-316ac3b090ee None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:01.342163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffba8d-29c2-4ffc-9d43-316ac3b090ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:01.344125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffba8d-29c2-4ffc-9d43-316ac3b090ee None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:01.375295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 244/474] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:53:01 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:01.392344 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63182692-9950-4818-a0c4-90d4cb67ce7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:01.393470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182692-9950-4818-a0c4-90d4cb67ce7b None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:01.393924 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182692-9950-4818-a0c4-90d4cb67ce7b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:01.394363 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182692-9950-4818-a0c4-90d4cb67ce7b None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:01.395270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63182692-9950-4818-a0c4-90d4cb67ce7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:01.397002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63182692-9950-4818-a0c4-90d4cb67ce7b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:01.424236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 231/475] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:53:01 2022] POST /identity/v3/users => generated 249 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:03.090529 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fbf5c-e290-405d-855e-e7801d846213 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.091038 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fbf5c-e290-405d-855e-e7801d846213 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.091152 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fbf5c-e290-405d-855e-e7801d846213 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.092747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 245/476] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:03.098782 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864cd62-d36d-48f3-92ff-cdbe5ee45bf1 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.099261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864cd62-d36d-48f3-92ff-cdbe5ee45bf1 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.099345 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864cd62-d36d-48f3-92ff-cdbe5ee45bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.118617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9864cd62-d36d-48f3-92ff-cdbe5ee45bf1 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:03.119955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9864cd62-d36d-48f3-92ff-cdbe5ee45bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:03.132007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:03.204087 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 232/477] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:03.547515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fbf5c-e290-405d-855e-e7801d846213 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:03.553113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9cdda-393a-4336-9372-e93fe3bed986 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.553712 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9cdda-393a-4336-9372-e93fe3bed986 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.554188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9cdda-393a-4336-9372-e93fe3bed986 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.556017 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 233/478] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:03.561626 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7018c-9815-4ebe-90c6-973d2dc0f351 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.562722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7018c-9815-4ebe-90c6-973d2dc0f351 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.563220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7018c-9815-4ebe-90c6-973d2dc0f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.590040 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-b0e7018c-9815-4ebe-90c6-973d2dc0f351 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:03.591677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b0e7018c-9815-4ebe-90c6-973d2dc0f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:03.688044 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fbf5c-e290-405d-855e-e7801d846213 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:03.696236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 234/479] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:03.727846 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de94a0-1eda-4a80-85e5-e944c9a448fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:03.728869 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de94a0-1eda-4a80-85e5-e944c9a448fd None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.729328 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de94a0-1eda-4a80-85e5-e944c9a448fd None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.729802 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de94a0-1eda-4a80-85e5-e944c9a448fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.741300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de94a0-1eda-4a80-85e5-e944c9a448fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-b2de94a0-1eda-4a80-85e5-e944c9a448fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:03.746787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:03.747688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:03.748517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:03.751337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 246/480] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:03.759896 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7018c-9815-4ebe-90c6-973d2dc0f351 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:03.784194 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e9eed-a838-46fa-b17d-1ebdf38b8d0a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.784949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e9eed-a838-46fa-b17d-1ebdf38b8d0a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.785478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e9eed-a838-46fa-b17d-1ebdf38b8d0a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.787835 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 247/481] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:03.793561 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7e7a-7b54-4994-b81f-b6e1fd4a3d3c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.794028 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7e7a-7b54-4994-b81f-b6e1fd4a3d3c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.794820 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7e7a-7b54-4994-b81f-b6e1fd4a3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.815108 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-2d3c7e7a-7b54-4994-b81f-b6e1fd4a3d3c None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:03.816348 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-2d3c7e7a-7b54-4994-b81f-b6e1fd4a3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:03.844468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:03.865223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:03.877436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7018c-9815-4ebe-90c6-973d2dc0f351 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:03.900699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 248/482] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:03.900699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fadc3-8bf1-49e2-bb77-002680481975 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.900699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fadc3-8bf1-49e2-bb77-002680481975 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.900699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fadc3-8bf1-49e2-bb77-002680481975 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.900699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 249/483] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:03.900699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0423a-6734-448f-97e4-801e8f60a427 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.900699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0423a-6734-448f-97e4-801e8f60a427 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.901365 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0423a-6734-448f-97e4-801e8f60a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.919567 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bcc0423a-6734-448f-97e4-801e8f60a427 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:03.921795 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bcc0423a-6734-448f-97e4-801e8f60a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:03.935365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:03.936503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:03.936933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:03.937486 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:03.938167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:03.938474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:03.940317 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:03.951731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 235/484] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:03.956851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:03.999394 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 250/485] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:04.031739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0423a-6734-448f-97e4-801e8f60a427 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.075178 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9839db-ad5a-4fbe-bce1-76456ab07f33 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.119816 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.121529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.122090 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.122904 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.127391 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:04.138602 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:04.141465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:04.151156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0423a-6734-448f-97e4-801e8f60a427 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:04.158425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:04.159358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:04.160229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:04.160229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:04.160229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:04.162384 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 236/486] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:04.162605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:04.167784 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.191986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e79c68-dd68-4be9-9168-83b057860723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.192747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79c68-dd68-4be9-9168-83b057860723 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.193114 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79c68-dd68-4be9-9168-83b057860723 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.193451 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79c68-dd68-4be9-9168-83b057860723 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.205883 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e79c68-dd68-4be9-9168-83b057860723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-77e79c68-dd68-4be9-9168-83b057860723 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:04.210933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:04.211870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:04.212743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:04.217039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 251/487] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:04.219383 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e79c68-dd68-4be9-9168-83b057860723 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.278140 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191b1ad-25e0-4d68-9d28-874ecfc60f25 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.315257 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.315870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.316150 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.316424 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.317097 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:04.317401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:04.318770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:04.332369 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 237/488] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:04.333200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.333719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e79c68-dd68-4be9-9168-83b057860723 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.369747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.370374 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.370649 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.370924 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.371577 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:04.371872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:04.373268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:04.381004 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 252/489] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:04.381784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.385194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:04.415566 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:04.436564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846d157-f280-4e87-ae4b-8d3d474d64d2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.470664 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798b55f-4491-4e56-adc8-c1aa9d98d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.471294 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b55f-4491-4e56-adc8-c1aa9d98d185 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.471572 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b55f-4491-4e56-adc8-c1aa9d98d185 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.471851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b55f-4491-4e56-adc8-c1aa9d98d185 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.481912 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798b55f-4491-4e56-adc8-c1aa9d98d185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0798b55f-4491-4e56-adc8-c1aa9d98d185 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:04.486573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:04.487652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:04.488547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 238/490] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:04.489425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798b55f-4491-4e56-adc8-c1aa9d98d185 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.492684 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff52a56-f8a5-4da4-9e8f-ce5f36601808 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.525932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.526872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.527153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.527427 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.535822 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:04.537303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:04.549380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:04.550353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 253/491] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:04.551292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.587391 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798b55f-4491-4e56-adc8-c1aa9d98d185 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.597295 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:04.622478 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c718fe8-8475-4ec4-b61f-2ff54fe5d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.623106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c718fe8-8475-4ec4-b61f-2ff54fe5d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.623387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c718fe8-8475-4ec4-b61f-2ff54fe5d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.623658 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c718fe8-8475-4ec4-b61f-2ff54fe5d4e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.635227 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c718fe8-8475-4ec4-b61f-2ff54fe5d4e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-7c718fe8-8475-4ec4-b61f-2ff54fe5d4e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:04.640541 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:04.641524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:04.642377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 239/492] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:04.643134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c718fe8-8475-4ec4-b61f-2ff54fe5d4e3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.650069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:04.662451 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a67f6-3907-4128-ab36-f89138a748f9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.696165 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.696812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.697090 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.697359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.709724 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:04.711180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:04.725478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:04.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:04.727808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:04.727808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:04.727808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:04.727808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 254/493] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:04.727808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.755847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c718fe8-8475-4ec4-b61f-2ff54fe5d4e3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.794008 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.794603 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.794878 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.795152 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.795809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:04.796106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:04.797513 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:04.806456 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 240/494] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:04.811578 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.841374 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23840f-0b84-49d4-8a31-cc672c5b28d0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.847144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:04.885277 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.885879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.886153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.886422 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.887142 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:04.887437 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:04.888884 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:04.923394 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7c56-cdfd-4cbf-b7d4-9dee643c5078 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:04.925684 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:04.930240 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 255/495] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:04.931684 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.958570 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:04.959170 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:04.959452 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:04.959724 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:04.960374 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:04.960701 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:04.962067 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:04.970659 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 241/496] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:04.971566 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.042880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f736fdf-b569-4fff-b09f-06f9fa08a942 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.064901 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.074197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fdeb-3b37-45b3-b36a-5ae08b639f6e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.078357 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.078971 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.079248 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.079584 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.080228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:05.080525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.082295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.114829 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 256/497] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:05.115058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.115058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.115058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.115058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.115571 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.124002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.126182 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:05.144068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:05.145070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:05.145955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:05.145955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:05.145955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:05.145955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 242/498] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:05.147063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.184782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.234935 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8fba-51b1-40d7-aca7-af25d12b744c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.259341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afeeae-2531-41fb-87aa-9a34b6c00a1a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.297870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c802-4584-4c09-81d7-75a80b8d49ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.298496 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c802-4584-4c09-81d7-75a80b8d49ec None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.298771 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c802-4584-4c09-81d7-75a80b8d49ec None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.299037 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c802-4584-4c09-81d7-75a80b8d49ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.299161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.299775 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.300059 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.300330 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.312497 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.314056 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.317511 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:05.331410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:05.332422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:05.333313 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:05.333313 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:05.333313 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:05.333313 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 243/499] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:05.333542 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.379604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549c802-4584-4c09-81d7-75a80b8d49ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.381040 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549c802-4584-4c09-81d7-75a80b8d49ec None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.438448 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718e856-00ae-4397-8c36-91ad21d13d96 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.442621 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.475465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.476214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.476502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.476813 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.485232 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.486690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.492506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 257/500] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:05.493471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c802-4584-4c09-81d7-75a80b8d49ec None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:05.500551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:05.501685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 244/501] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:05.502690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.559669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.597734 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c802-4584-4c09-81d7-75a80b8d49ec None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.605123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3824-b413-461f-863d-e4dc6dee0626 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.631622 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.632147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.632425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.632731 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.633373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:05.633676 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.635049 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.638791 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.639396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.639674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.640438 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.641114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:05.641419 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.642782 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.647006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 258/502] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:05.647858 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.657372 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 245/503] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:05.658198 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.673724 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.750695 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8869ca0-0b4c-4a5a-9642-992817dcd8a4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.757473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6de5-0921-4e10-9b23-be8afd80cf01 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.777822 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.786527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.787153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.787431 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.787702 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.796397 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.796753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.797034 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.797307 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.798031 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:05.798137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.798331 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.799570 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.799728 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:05.813295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:05.814237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:05.815108 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:05.815108 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:05.815108 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:05.815108 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 259/504] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:05.815594 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.840621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 246/505] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:05.841494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.887561 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.918959 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5d1c7-23c7-4c90-99e7-533a6d7bf5e5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.946314 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bdbbf-38d1-4233-ad89-c6d5677cda7b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.953641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.954687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.954971 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.955250 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.963243 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.964816 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:05.976148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:05.977117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:05.978052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 260/506] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:05.978636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.983307 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.984422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.984723 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.984994 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.992143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.993896 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:06.005395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:06.006319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:06.007239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 247/507] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:06.007802 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.042238 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.079368 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f3f3f-9a20-4f11-b095-699c2d6aec83 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.108184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.113163 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caec45-0b6d-4033-bc01-48dd26897c7f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.115707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.116309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.116585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.116893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.117528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:06.117826 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.119197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.131031 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 261/508] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:06.131865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.149352 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c712-0c0a-41cc-9d13-6ec69bf9ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.149868 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c712-0c0a-41cc-9d13-6ec69bf9ac4c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.150136 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c712-0c0a-41cc-9d13-6ec69bf9ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.150405 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8c712-0c0a-41cc-9d13-6ec69bf9ac4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.219291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8c712-0c0a-41cc-9d13-6ec69bf9ac4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.220823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8c712-0c0a-41cc-9d13-6ec69bf9ac4c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.230328 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32971f95-1e2e-4d28-bb63-a8f6f77122fe None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.253814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.265499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.266100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.266375 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.266646 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.267363 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:06.267663 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.269133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.286702 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 262/509] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:06.287763 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.325537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 248/510] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:06.326394 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c712-0c0a-41cc-9d13-6ec69bf9ac4c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.339132 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.391462 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b988a1-4302-4bf4-955a-ec034e8319e6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.425828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.426364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.426644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.426916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.427636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:06.427938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.428597 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8c712-0c0a-41cc-9d13-6ec69bf9ac4c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.429391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.447076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 263/511] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:06.447948 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.466143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.466764 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.467038 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.467304 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.469994 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.475458 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.477126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:06.488465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:06.489379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:06.490247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 249/512] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:06.490718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.553915 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b9f7a-b305-4749-8d98-38acf478ce3f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.563076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.589005 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745194c-d280-4cf0-969f-91a4bbe5e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.589603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745194c-d280-4cf0-969f-91a4bbe5e42c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.589880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745194c-d280-4cf0-969f-91a4bbe5e42c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.590150 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745194c-d280-4cf0-969f-91a4bbe5e42c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.604214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1323862-6c55-4a4c-a0da-d45a20d70105 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.637274 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.637900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.638183 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.638468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.649833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.651283 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.657215 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745194c-d280-4cf0-969f-91a4bbe5e42c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.658653 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745194c-d280-4cf0-969f-91a4bbe5e42c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:06.665465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:06.666449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:06.667356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:06.667356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:06.667356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:06.667356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 250/513] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:06.667356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.715593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.757920 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 264/514] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:06.758677 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745194c-d280-4cf0-969f-91a4bbe5e42c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.769301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.773112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a119bc-35c1-4351-8c20-905e865e81a6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.807589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ca51-991a-491e-8a00-0456f6d0a70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.808186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ca51-991a-491e-8a00-0456f6d0a70c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.808463 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ca51-991a-491e-8a00-0456f6d0a70c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.808772 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ca51-991a-491e-8a00-0456f6d0a70c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.868038 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745194c-d280-4cf0-969f-91a4bbe5e42c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.879409 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ca51-991a-491e-8a00-0456f6d0a70c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.880919 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ca51-991a-491e-8a00-0456f6d0a70c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.905148 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.905767 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.906045 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.906316 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.907012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:06.907399 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.908814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.927073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 265/515] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:06.927908 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.933399 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.985334 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 251/516] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:06.986103 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ca51-991a-491e-8a00-0456f6d0a70c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.000508 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.034383 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549256d-dc39-42a6-ba5d-c3e07fd08cd9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.068251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.068882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.069183 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.069450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.070083 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:07.070385 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.071768 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.083965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 266/517] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:07.084816 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.085414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ca51-991a-491e-8a00-0456f6d0a70c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.121457 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.122087 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.122362 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.122628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.133334 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.134796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.142171 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:07.150444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:07.151879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:07.152796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:07.152796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:07.152796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:07.152796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 252/518] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:07.152796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.191622 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca1f1a-08df-4893-ba81-c8bb859ec8ce None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.219538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.229204 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.229817 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.230093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.230362 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.231087 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=61b8da64c241441d986c7c11f3fe2e9d) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:07.231392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.232875 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.239271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 267/519] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/role_assignments?user.id=61b8da64c241441d986c7c11f3fe2e9d&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:07.239853 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.272840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d555e-9f74-4493-a8f5-f6e7ff3a8433 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.318034 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.318288 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.318699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.319132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.338280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.340944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:07.367681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:07.368703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:07.369586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:07.369586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:07.369586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:07.369586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 253/520] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:07.370534 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.390108 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8fd5f-2da8-4d10-84b4-7ef8a0f1aabe None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.433402 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.434173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.434359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.434626 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.434908 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.443969 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.445988 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:07.458003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:07.458932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:07.459818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 268/521] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:07.460288 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.494511 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7ed22-3f9c-4057-8224-091c56e8ebca None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.520218 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.531092 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.531718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.532002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.532267 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.532941 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:07.533243 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.534629 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.546969 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 254/522] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:07.549568 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.588372 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484cb4b-a5e9-4826-9430-7ef0e6ec3cfc None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.630256 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.631197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.631660 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.632166 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.633021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:07.633504 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.635214 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.651875 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 269/523] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:07.653189 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.671613 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81c83e-b609-4dd7-b151-358747e5a76e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.685204 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.717516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.718912 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.719193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.719708 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.720874 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:07.721153 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.722873 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.743088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 255/524] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:07.744056 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.770662 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfad2c-d8e5-4396-8e35-aa1aa5c42815 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.790596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.818058 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.818870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.819243 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.819630 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.827742 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.829608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:07.842353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:07.844056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:07.845247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:07.845247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:07.845247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:07.845247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:07.845247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:07.845247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:07.845247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:07.845247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:07.850539 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 270/525] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:07.850763 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.869445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59bd20-cfaf-44c5-b457-2a72a7dfb176 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.911561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:07.912345 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.912765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.913131 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.921378 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:07.922963 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:07.935144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:07.936301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:07.937380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:07.937380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:07.937380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:07.937380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:07.937380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:07.937380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:07.937380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:07.937380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:07.941470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 256/526] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:07.942370 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.971296 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45841905-a3c4-4383-bc5c-919c66235234 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:07.991651 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:08.009966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.010667 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.011021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.011476 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.012176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=e9039bb844c14a8789c6f30e461f77c0) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:08.012800 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.014107 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.028780 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 271/527] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/role_assignments?user.id=e9039bb844c14a8789c6f30e461f77c0&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:08.028780 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:08.081882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:08.086623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3644d1-8108-48fb-ab7d-e60499514ba6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.130337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.131213 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.131668 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.132466 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.133365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:08.134148 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.136074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.153946 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 257/528] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:08.161474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:08.166239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19f9de-c303-4cbc-ab82-4bb73210f85b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.204414 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.205041 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.205318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.205589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.207163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:08.207163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.208051 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.227029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 272/529] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:08.228687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:08.281851 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:08.295063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f88cb6-7a90-407e-94bf-e8ea026fc156 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.341490 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:08.343880 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2acbe-4458-49a6-8f94-cd616da086c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.344847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2acbe-4458-49a6-8f94-cd616da086c8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.345280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2acbe-4458-49a6-8f94-cd616da086c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.346042 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2acbe-4458-49a6-8f94-cd616da086c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.347477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2acbe-4458-49a6-8f94-cd616da086c8 None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=7712bef2122745c3b05aad9e4dff7c12) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:08.347937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2acbe-4458-49a6-8f94-cd616da086c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.349386 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e01cd-b330-49c3-8341-3d827ec54aa1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.349859 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2acbe-4458-49a6-8f94-cd616da086c8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.358260 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 258/530] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:08 2022] GET /identity/v3/role_assignments?user.id=7712bef2122745c3b05aad9e4dff7c12&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:08.398422 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4889-eb74-4b16-9d9b-41d04cdfd2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.399302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4889-eb74-4b16-9d9b-41d04cdfd2a5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.399722 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4889-eb74-4b16-9d9b-41d04cdfd2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.400089 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4889-eb74-4b16-9d9b-41d04cdfd2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.401100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4889-eb74-4b16-9d9b-41d04cdfd2a5 None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=b7495e57630d4978a2a5c1681b8578c4) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:08.401479 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4889-eb74-4b16-9d9b-41d04cdfd2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.403040 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4889-eb74-4b16-9d9b-41d04cdfd2a5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.410304 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 273/531] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:08 2022] GET /identity/v3/role_assignments?user.id=b7495e57630d4978a2a5c1681b8578c4&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:09.462325 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51fd6-eb8d-4087-b521-b902c20b031c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:09.462848 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51fd6-eb8d-4087-b521-b902c20b031c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:09.462848 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51fd6-eb8d-4087-b521-b902c20b031c None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:09.464436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 259/532] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:09.470887 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35cfca-570c-4f25-b863-0f4200ae04d9 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:09.471359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35cfca-570c-4f25-b863-0f4200ae04d9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:09.471450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35cfca-570c-4f25-b863-0f4200ae04d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:09.490062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-5f35cfca-570c-4f25-b863-0f4200ae04d9 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:09.491252 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-5f35cfca-570c-4f25-b863-0f4200ae04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:09.572595 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 274/533] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:09.900911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce51fd6-eb8d-4087-b521-b902c20b031c None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:10.004588 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce51fd6-eb8d-4087-b521-b902c20b031c None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:10.038793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5e0de-9ab1-4b8f-a89c-c505b91c7c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:10.039425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e0de-9ab1-4b8f-a89c-c505b91c7c94 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.039701 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e0de-9ab1-4b8f-a89c-c505b91c7c94 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.039971 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e0de-9ab1-4b8f-a89c-c505b91c7c94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.050810 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5e0de-9ab1-4b8f-a89c-c505b91c7c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-17d5e0de-9ab1-4b8f-a89c-c505b91c7c94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:10.055590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:10.056514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:10.057366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 260/534] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:10.063608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35cfca-570c-4f25-b863-0f4200ae04d9 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:10.173830 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:10.188691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35cfca-570c-4f25-b863-0f4200ae04d9 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:10.227988 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fad5c-040f-4e56-a153-8df805d0d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:10.228592 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fad5c-040f-4e56-a153-8df805d0d781 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.228898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fad5c-040f-4e56-a153-8df805d0d781 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.229169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fad5c-040f-4e56-a153-8df805d0d781 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.229889 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fad5c-040f-4e56-a153-8df805d0d781 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:10.230189 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fad5c-040f-4e56-a153-8df805d0d781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:10.231573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fad5c-040f-4e56-a153-8df805d0d781 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:10.241337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 275/535] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:10.246759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5e0de-9ab1-4b8f-a89c-c505b91c7c94 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:10.264417 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:10.343299 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ee65-c741-4ceb-a15e-7188927cf447 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.343938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ee65-c741-4ceb-a15e-7188927cf447 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.344414 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042ee65-c741-4ceb-a15e-7188927cf447 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.346313 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 276/536] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:10.351940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af8d02-7b54-495c-b5e1-6f1eda34528b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.352502 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af8d02-7b54-495c-b5e1-6f1eda34528b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.352992 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af8d02-7b54-495c-b5e1-6f1eda34528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.363506 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5e0de-9ab1-4b8f-a89c-c505b91c7c94 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:10.372590 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b3af8d02-7b54-495c-b5e1-6f1eda34528b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:10.374678 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b3af8d02-7b54-495c-b5e1-6f1eda34528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:10.407229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:10.407861 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.408135 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.408406 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.422611 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:10.424741 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:10.444889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:10.445992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:10.446882 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:10.446882 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:10.446882 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:10.446882 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 261/537] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:10.460720 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:10.465003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 277/538] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:10.535515 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:10.582955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1553a-ff92-440f-acd8-31d8ca4e6361 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:10.622956 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebbbc7-79f7-484b-83d8-eab4158063d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:10.623940 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbbc7-79f7-484b-83d8-eab4158063d5 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.624472 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbbc7-79f7-484b-83d8-eab4158063d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.624976 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbbc7-79f7-484b-83d8-eab4158063d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.625946 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbbc7-79f7-484b-83d8-eab4158063d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:10.626460 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbbc7-79f7-484b-83d8-eab4158063d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:10.628117 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbbc7-79f7-484b-83d8-eab4158063d5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:10.642571 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 262/539] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:10.649534 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af8d02-7b54-495c-b5e1-6f1eda34528b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:10.654636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc1104-2a8a-4550-9127-cd95f8d3e0e9 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.654920 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc1104-2a8a-4550-9127-cd95f8d3e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.655196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc1104-2a8a-4550-9127-cd95f8d3e0e9 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.657490 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 263/540] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:10.663028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab6ea-c128-4930-aef8-81eac3ba8c4a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.663502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab6ea-c128-4930-aef8-81eac3ba8c4a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.663983 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab6ea-c128-4930-aef8-81eac3ba8c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.683792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-a41ab6ea-c128-4930-aef8-81eac3ba8c4a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:10.685319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a41ab6ea-c128-4930-aef8-81eac3ba8c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:10.767325 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 264/541] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:10.768974 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b620c5-fba5-4540-9707-f1d4a21778e6 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.769492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b620c5-fba5-4540-9707-f1d4a21778e6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.769964 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b620c5-fba5-4540-9707-f1d4a21778e6 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.771685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 265/542] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:10.777457 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563bac7-c3bc-470e-b757-3ccd330d5331 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.778197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563bac7-c3bc-470e-b757-3ccd330d5331 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.778811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563bac7-c3bc-470e-b757-3ccd330d5331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.781427 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:10.802317 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af8d02-7b54-495c-b5e1-6f1eda34528b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:10.809360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e563bac7-c3bc-470e-b757-3ccd330d5331 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:10.812151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e563bac7-c3bc-470e-b757-3ccd330d5331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:10.850603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:10.851250 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:10.851531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:10.851803 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:10.859733 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:10.861224 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:10.878198 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:10.879211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:10.880128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 278/543] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 09:53:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:10.885581 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:10.914096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:10.943906 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 266/544] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:10.945682 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563bac7-c3bc-470e-b757-3ccd330d5331 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.002529 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262b80-e0a7-44c7-a0bf-5d08683f14a1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.037702 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.038324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.038595 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.038887 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.040492 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:11.040857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.042494 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.061064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.068814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 279/545] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 09:53:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:11.072142 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.083144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563bac7-c3bc-470e-b757-3ccd330d5331 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.130648 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95349f-e2ba-4c4c-8f47-66244d9fc5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.131499 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95349f-e2ba-4c4c-8f47-66244d9fc5ec None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.131980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95349f-e2ba-4c4c-8f47-66244d9fc5ec None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.132214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95349f-e2ba-4c4c-8f47-66244d9fc5ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.142889 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95349f-e2ba-4c4c-8f47-66244d9fc5ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0a95349f-e2ba-4c4c-8f47-66244d9fc5ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:11.147557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:11.148473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:11.149327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 267/546] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:11.150044 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95349f-e2ba-4c4c-8f47-66244d9fc5ec None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.200528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d20cb-cf04-45da-b695-ca4410d21060 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.201526 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.238116 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.238760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.239039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.239316 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.250570 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.252030 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.263147 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95349f-e2ba-4c4c-8f47-66244d9fc5ec None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:11.267076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:11.267987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:11.268901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:11.268901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:11.268901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:11.268901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 280/547] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:11.269137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.302401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35e38e-86f5-41a2-b056-e33b8853f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.303107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35e38e-86f5-41a2-b056-e33b8853f26f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.303395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35e38e-86f5-41a2-b056-e33b8853f26f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.303662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35e38e-86f5-41a2-b056-e33b8853f26f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.313624 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35e38e-86f5-41a2-b056-e33b8853f26f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-5c35e38e-86f5-41a2-b056-e33b8853f26f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:11.318194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:11.319249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:11.320074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 268/548] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:11.320792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35e38e-86f5-41a2-b056-e33b8853f26f None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.327591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.376674 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3e19-8d2c-41d4-bda1-64ddf4ce90ff None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.411245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.411851 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.412131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.412405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.413087 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:11.413392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.414789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.423602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 281/549] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:11.424675 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.430628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35e38e-86f5-41a2-b056-e33b8853f26f None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.438386 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.464811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.465342 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.465628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.465902 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.466539 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:11.466840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.468788 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.479920 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 269/550] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:11.480771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.523812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b01ec6-4ce4-4e40-92b3-ecded5e4816e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.537787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.558980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e1a9a-14a6-4c20-a5a3-4b637843004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.559618 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1a9a-14a6-4c20-a5a3-4b637843004d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.559899 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1a9a-14a6-4c20-a5a3-4b637843004d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.560173 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e1a9a-14a6-4c20-a5a3-4b637843004d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.570772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e1a9a-14a6-4c20-a5a3-4b637843004d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-f88e1a9a-14a6-4c20-a5a3-4b637843004d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:11.575939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:11.577101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 282/551] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:11.579012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e1a9a-14a6-4c20-a5a3-4b637843004d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.586942 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a8c0f-3e7a-4993-8aa8-465d94f63d85 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.626397 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.627004 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.627300 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.627553 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.628211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:11.628511 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.629899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.637907 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 270/552] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:11.638706 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.666935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.685900 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e1a9a-14a6-4c20-a5a3-4b637843004d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.721833 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.722372 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.722648 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.722914 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.734596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.736053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.740469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc6d0d-dbd9-43f3-a235-341ea6603dbd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:11.749827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:11.750986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:11.751896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:11.751896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:11.751896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:11.751896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 283/553] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:11.752212 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.776309 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.777000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.777287 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.777564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.779355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.785328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.786840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:11.798337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:11.803833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 271/554] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:11.805010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.862366 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f1b01-f4f8-4e12-9f78-46469f7159f9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.897629 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.897880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.898509 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.898791 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.899093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.899823 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:11.900144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.901648 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.911809 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 284/555] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:11.912700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.922666 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d440c85-f7a9-405e-9620-b446ea9ee16e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:11.964650 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:11.965492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.965837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.966288 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.981007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:11.982419 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:11.997054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:11.998188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:11.999172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:11.999172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:11.999172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:11.999172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 272/556] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:11.999172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.010698 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.026332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545ebac-6b44-4b2d-b660-57020060ddda None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.060628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.061251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.062058 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.062323 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.062952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:12.063246 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.064651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.078949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 285/557] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:12.080317 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.117290 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb55ea-c866-4828-835c-de5988221e1d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.154407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.155265 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.155607 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.155938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.156837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:12.157211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.159312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.169940 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.173345 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 273/558] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:12.174315 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.193741 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf11c6-e3cb-4859-adf9-f559fb809f58 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.229370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.230003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.230282 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.230553 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.241004 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.242472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.251963 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:12.259113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:12.260693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:12.262157 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:12.262157 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:12.262157 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:12.262157 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 286/559] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:12.262157 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.278117 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110eaf2-9386-4b0b-8f25-d424bd4eb5e1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.311396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.312491 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.312800 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.313102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.313739 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:12.314043 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.315441 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.328341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 274/560] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:12.329171 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.362117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48d29e-5d05-4340-b376-3fd311047b92 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.387949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.396593 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.397237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.397517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.397787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.405153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.406615 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:12.417511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:12.424185 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 287/561] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:12.425230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.431832 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cddd24-ae82-47a2-b4f7-8111f67eb663 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.465965 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9b8a-2c73-4502-a956-9a981a8b0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.466628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9b8a-2c73-4502-a956-9a981a8b0b66 None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.466909 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9b8a-2c73-4502-a956-9a981a8b0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.467183 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9b8a-2c73-4502-a956-9a981a8b0b66 None admin] PATH_INFO: `/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/61b8da64c241441d986c7c11f3fe2e9d/roles/de1e47b3393d4aaa872b8134a9578058` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.477267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.482408 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca9b8a-2c73-4502-a956-9a981a8b0b66 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64d42bc4e7840c194ea6c42c4b1be8e, user_id=61b8da64c241441d986c7c11f3fe2e9d, role_id=de1e47b3393d4aaa872b8134a9578058)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.484352 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca9b8a-2c73-4502-a956-9a981a8b0b66 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.497785 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 275/562] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:53:12 2022] PUT /identity/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/61b8da64c241441d986c7c11f3fe2e9d/roles/de1e47b3393d4aaa872b8134a9578058 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:12.498597 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9b8a-2c73-4502-a956-9a981a8b0b66 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.535411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b003e04-d4d4-4c63-86fe-0c050558375d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.578688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.579324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.579610 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.579882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.580553 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:12.580891 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.582350 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.596420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 288/563] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:12.597178 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.637321 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9b8a-2c73-4502-a956-9a981a8b0b66 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.651413 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.688144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.688501 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.688763 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.689035 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.700076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.701827 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:12.717141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:12.718420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:53:12.719420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:12.719960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 276/564] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:12.725121 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.725261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16050319-22f3-4bc1-9418-e29518a300a0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.745356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.761940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.762485 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.762773 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.763046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.763776 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:12.764071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.765609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.785006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 289/565] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:12.785657 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.843292 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17caba-88f4-4864-bf0a-38f5aa6ad5dd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.880251 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.881047 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.881333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.881632 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.890122 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.891804 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.897620 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfba48f-fba5-4821-bc91-ccf3d5bfd197 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:12.903700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:12.904702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:53:12.906219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:12.908863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 277/566] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:12.913886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:12.942828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.943396 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.943676 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.944113 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.944687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:12.945079 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.946446 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.946955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.967367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 290/567] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:12.968588 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.015716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.032401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ea905-486f-4860-b0a0-5a05d59fdf8b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.069298 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.069930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.070206 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.070475 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.082046 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.083516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:13.097958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:13.098958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:13.099870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:13.099870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:13.099870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:13.099870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 278/568] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:13.099870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.101309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a9a2-a344-4a2d-9754-f5370afd000b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.154584 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.155596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.155879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.156357 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.158080 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:13.158300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.161037 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.193535 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 291/569] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 24 09:53:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:13.194888 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.201055 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.222814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f7f51-8743-42ef-a592-d0f49d2ce6f3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.268501 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.269065 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.269356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.269634 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.282013 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.283589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:13.299404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:13.300450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:13.301897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:13.301897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:13.301897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:13.301897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 279/570] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:13.301897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.323587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.333890 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e0dd3-7b4b-47a5-b3a2-ef2ec452dd32 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.377679 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.378309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.378593 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.378869 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.379536 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:13.379832 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.382609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.395145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 292/571] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:13.395841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.436863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09601a6a-b290-453b-966d-13594e129a85 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.477909 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.478544 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.478829 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.479102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.481662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.491861 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.494878 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.512155 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81b77a-dc50-4d37-a31b-ce6910ad1148 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:13.517197 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:13.518184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:13.519151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:13.519151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:13.519151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:13.523147 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 280/572] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:13.524059 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.551559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.551864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.552136 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.552416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.553087 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:13.553386 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.554783 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.570729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 293/573] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:13.571993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.591996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.655244 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe830da7-54f6-4254-a865-38b8aace8c0b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.688360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae5357-3c59-49d2-b6f7-93c577be7081 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.694282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.695189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.695669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.696182 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.704687 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.706644 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:13.719473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:13.720428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:13.721407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:13.721407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:13.721407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:13.721407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:13.721407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:13.721407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:13.721407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:13.721407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:13.723094 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 281/574] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:13.724114 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.724239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.724585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.724802 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.725399 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.725500 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:13.725909 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.727089 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.739401 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 294/575] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:13.740299 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.781014 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.818959 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.840578 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187439-c81a-4277-b88d-545cd19afe22 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.853270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d295-909c-4ef9-8ee1-0988c2b96128 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:13.879288 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.880084 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.880374 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.880987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.888017 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:13.888618 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:13.888934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:13.889212 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:13.889585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.890455 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:13.890761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:13.891967 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.892237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:13.903753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:13.904749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:13.906537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:13.906537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:13.906537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:13.906537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:13.906537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:13.906537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:13.906537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:13.906537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:13.911932 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 282/576] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:13.912073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 295/577] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:13.912175 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:13.912414 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:14.016022 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a83c02-2cd3-4b8b-a425-c32d86747c5c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:14.023240 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e9a4-7a41-4664-aac5-92ab98f7e19d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:14.031437 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:14.052222 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaaedd-7b7d-4807-92a0-ba87f9d71a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:14.052912 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaaedd-7b7d-4807-92a0-ba87f9d71a85 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.053200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaaedd-7b7d-4807-92a0-ba87f9d71a85 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.053472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaaedd-7b7d-4807-92a0-ba87f9d71a85 None admin] PATH_INFO: `/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/e9039bb844c14a8789c6f30e461f77c0/roles/de1e47b3393d4aaa872b8134a9578058` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.055914 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:14.064702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:14.065352 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.065636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.065912 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.070309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaaedd-7b7d-4807-92a0-ba87f9d71a85 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64d42bc4e7840c194ea6c42c4b1be8e, user_id=e9039bb844c14a8789c6f30e461f77c0, role_id=de1e47b3393d4aaa872b8134a9578058)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:14.071760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaaedd-7b7d-4807-92a0-ba87f9d71a85 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:14.073331 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:14.075032 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:14.092719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 296/578] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:53:13 2022] PUT /identity/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/e9039bb844c14a8789c6f30e461f77c0/roles/de1e47b3393d4aaa872b8134a9578058 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:14.092719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaaedd-7b7d-4807-92a0-ba87f9d71a85 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:14.093270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:14.094118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:14.095029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 283/579] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:14.095601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:14.208674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc258c-0948-428e-a23a-fed92a036fb2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:14.220471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaaedd-7b7d-4807-92a0-ba87f9d71a85 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:14.254830 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:14.255454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.255740 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.256019 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.256789 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:14.257101 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:14.258614 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:14.270193 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:14.271840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.272650 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.273202 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.274140 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:14.279031 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 284/580] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:14.279205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:14.279205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:14.282020 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:14.298450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 297/581] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:14.299814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:14.315635 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:14.357358 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:14.410128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37447735-21c5-497a-9c4c-8dd0b34487bb None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:14.423333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1480df-cd08-474f-b5a3-5f253767b28a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:14.450682 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fab83b-4490-4c38-900c-85a8ccacab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:14.451488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fab83b-4490-4c38-900c-85a8ccacab7e None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.451771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fab83b-4490-4c38-900c-85a8ccacab7e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.452102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fab83b-4490-4c38-900c-85a8ccacab7e None admin] PATH_INFO: `/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/b7495e57630d4978a2a5c1681b8578c4/roles/de1e47b3393d4aaa872b8134a9578058` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.468578 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fab83b-4490-4c38-900c-85a8ccacab7e None admin] RBAC: Authorizing `identity:create_grant(project_id=e64d42bc4e7840c194ea6c42c4b1be8e, user_id=b7495e57630d4978a2a5c1681b8578c4, role_id=de1e47b3393d4aaa872b8134a9578058)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:14.470179 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fab83b-4490-4c38-900c-85a8ccacab7e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:14.471960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd3699-29f3-4bdc-bbc4-a3bcc9b6f350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:14.473002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3699-29f3-4bdc-bbc4-a3bcc9b6f350 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.473370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3699-29f3-4bdc-bbc4-a3bcc9b6f350 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.474142 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3699-29f3-4bdc-bbc4-a3bcc9b6f350 None admin] PATH_INFO: `/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/7712bef2122745c3b05aad9e4dff7c12/roles/de1e47b3393d4aaa872b8134a9578058` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.487200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 285/582] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:53:14 2022] PUT /identity/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/b7495e57630d4978a2a5c1681b8578c4/roles/de1e47b3393d4aaa872b8134a9578058 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:14.494794 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3699-29f3-4bdc-bbc4-a3bcc9b6f350 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64d42bc4e7840c194ea6c42c4b1be8e, user_id=7712bef2122745c3b05aad9e4dff7c12, role_id=de1e47b3393d4aaa872b8134a9578058)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:14.496367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3699-29f3-4bdc-bbc4-a3bcc9b6f350 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:14.514201 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 298/583] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:53:14 2022] PUT /identity/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/7712bef2122745c3b05aad9e4dff7c12/roles/de1e47b3393d4aaa872b8134a9578058 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:14.789705 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8235-3e1b-41e5-815f-1149c5f52441 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.790229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8235-3e1b-41e5-815f-1149c5f52441 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.790580 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8235-3e1b-41e5-815f-1149c5f52441 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.792427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 286/584] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:14.798126 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060bd0b-2436-4d8b-a541-79a5d30fd92c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.799018 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060bd0b-2436-4d8b-a541-79a5d30fd92c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.799489 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060bd0b-2436-4d8b-a541-79a5d30fd92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.822155 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-6060bd0b-2436-4d8b-a541-79a5d30fd92c None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:14.823690 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-6060bd0b-2436-4d8b-a541-79a5d30fd92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:14.894201 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 299/585] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:15.226012 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8235-3e1b-41e5-815f-1149c5f52441 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:15.308580 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:15.334793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8235-3e1b-41e5-815f-1149c5f52441 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:15.372902 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf189f-71e4-427e-92aa-c0fe98043695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:15.373547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf189f-71e4-427e-92aa-c0fe98043695 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:15.373828 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf189f-71e4-427e-92aa-c0fe98043695 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:15.374636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf189f-71e4-427e-92aa-c0fe98043695 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:15.385690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf189f-71e4-427e-92aa-c0fe98043695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-cfdf189f-71e4-427e-92aa-c0fe98043695 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:15.391414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:15.392381 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:15.393282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 287/586] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:15.400088 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060bd0b-2436-4d8b-a541-79a5d30fd92c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:15.426549 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:15.506901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060bd0b-2436-4d8b-a541-79a5d30fd92c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:15.541186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:15.541796 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:15.542077 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:15.542350 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:15.543007 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:15.543307 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:15.544688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:15.553693 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 300/587] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:15.559102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf189f-71e4-427e-92aa-c0fe98043695 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:15.665032 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf189f-71e4-427e-92aa-c0fe98043695 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:15.702501 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:15.703161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:15.703446 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:15.703720 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:15.706972 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:15.715327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:15.717194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:15.735494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:15.736519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:15.737474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:15.737474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:15.737474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:15.737474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 288/588] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:15.742372 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:15.837766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:15.854202 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d61a7-db5e-40f2-8b56-1428a638bcd7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:15.890045 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:15.890667 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:15.890947 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:15.891222 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:15.891870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:15.892170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:15.893589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:15.907130 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 301/589] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:15.912426 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:16.026186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ef54-2fc1-49f3-a0a6-6c3dda7889dc None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:16.065639 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:16.066376 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:16.066573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:16.066804 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:16.076112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:16.078194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:16.090280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:16.092168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:16.093595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 289/590] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 09:53:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:16.097237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:16.209452 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93294c27-a805-42ce-b026-a066afc40629 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:16.246610 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d75d2-cc5e-452d-a82d-22f2fabfa13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:16.247233 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d75d2-cc5e-452d-a82d-22f2fabfa13f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:16.247495 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d75d2-cc5e-452d-a82d-22f2fabfa13f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:16.247767 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d75d2-cc5e-452d-a82d-22f2fabfa13f None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:16.248501 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d75d2-cc5e-452d-a82d-22f2fabfa13f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:16.248881 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d75d2-cc5e-452d-a82d-22f2fabfa13f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:16.250881 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d75d2-cc5e-452d-a82d-22f2fabfa13f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:16.270427 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 302/591] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 09:53:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:16.282256 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:16.337700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:16.400425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4671-ef60-425c-8a02-f44d170e8c1a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:16.441926 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bdd01-c51c-4212-a249-ef97bc0cf09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:16.442551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bdd01-c51c-4212-a249-ef97bc0cf09b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:16.443002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bdd01-c51c-4212-a249-ef97bc0cf09b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:16.443299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bdd01-c51c-4212-a249-ef97bc0cf09b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:16.524745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424f798-60de-4204-86dc-1225006fb3f6 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:16.525622 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424f798-60de-4204-86dc-1225006fb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:16.525622 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424f798-60de-4204-86dc-1225006fb3f6 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:16.526897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 303/592] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:16.527897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bdd01-c51c-4212-a249-ef97bc0cf09b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:16.532418 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bdd01-c51c-4212-a249-ef97bc0cf09b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:16.533052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4eba-aeac-493a-9212-1737e1165703 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:16.533338 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4eba-aeac-493a-9212-1737e1165703 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:16.534464 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e4eba-aeac-493a-9212-1737e1165703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:16.546518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:16.552977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bc9e4eba-aeac-493a-9212-1737e1165703 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:16.554367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bc9e4eba-aeac-493a-9212-1737e1165703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:16.586249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:16.642306 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 304/593] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:16.659402 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 290/594] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:16.665267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e4eba-aeac-493a-9212-1737e1165703 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:16.790169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e4eba-aeac-493a-9212-1737e1165703 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:16.831773 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404166-3782-49f3-ab1e-919ece9828c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:16.832782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404166-3782-49f3-ab1e-919ece9828c2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:16.833237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404166-3782-49f3-ab1e-919ece9828c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:16.833696 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404166-3782-49f3-ab1e-919ece9828c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:16.835907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:16.847036 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4404166-3782-49f3-ab1e-919ece9828c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:16.849397 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4404166-3782-49f3-ab1e-919ece9828c2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-b4404166-3782-49f3-ab1e-919ece9828c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:16.865790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:16.866836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:16.867754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:16.867754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:16.867754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:16.869620 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 305/595] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:16.876294 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bdd01-c51c-4212-a249-ef97bc0cf09b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:16.923903 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177869fc-f4f1-49ed-978d-a4826a743c94 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:16.924178 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177869fc-f4f1-49ed-978d-a4826a743c94 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:16.924451 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177869fc-f4f1-49ed-978d-a4826a743c94 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:16.926206 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 306/596] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:16.935092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cbc8-8212-426a-a512-8c04313533c3 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:16.935432 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cbc8-8212-426a-a512-8c04313533c3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:16.935713 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220cbc8-8212-426a-a512-8c04313533c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:16.961910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-1220cbc8-8212-426a-a512-8c04313533c3 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:16.963143 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1220cbc8-8212-426a-a512-8c04313533c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:16.999916 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bdd01-c51c-4212-a249-ef97bc0cf09b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.036413 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987ac11-86d0-444e-9bfa-bfaf62d63b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.036638 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 307/597] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:17.037070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ac11-86d0-444e-9bfa-bfaf62d63b42 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.037347 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ac11-86d0-444e-9bfa-bfaf62d63b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.037617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ac11-86d0-444e-9bfa-bfaf62d63b42 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.037865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860b26-ba37-4c1c-8c05-f0bacb4def8e None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.038153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860b26-ba37-4c1c-8c05-f0bacb4def8e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.038249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987ac11-86d0-444e-9bfa-bfaf62d63b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:17.038497 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860b26-ba37-4c1c-8c05-f0bacb4def8e None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.038609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987ac11-86d0-444e-9bfa-bfaf62d63b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:17.039944 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 308/598] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:17.040060 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987ac11-86d0-444e-9bfa-bfaf62d63b42 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:17.041500 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a860b26-ba37-4c1c-8c05-f0bacb4def8e None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.065952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 291/599] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:17.067564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178430cc-9550-436e-800a-ad37febbf818 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.067856 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178430cc-9550-436e-800a-ad37febbf818 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.068136 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178430cc-9550-436e-800a-ad37febbf818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.087986 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-178430cc-9550-436e-800a-ad37febbf818 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:17.089222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-178430cc-9550-436e-800a-ad37febbf818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:17.091323 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:17.159567 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a860b26-ba37-4c1c-8c05-f0bacb4def8e None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.163151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 292/600] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:17.165609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178430cc-9550-436e-800a-ad37febbf818 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.179155 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:17.199758 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f60e21-4be0-40fb-a07e-371af20e5e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.201008 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f60e21-4be0-40fb-a07e-371af20e5e77 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.201499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f60e21-4be0-40fb-a07e-371af20e5e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.202503 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f60e21-4be0-40fb-a07e-371af20e5e77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.214357 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f60e21-4be0-40fb-a07e-371af20e5e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-41f60e21-4be0-40fb-a07e-371af20e5e77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:17.220960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:17.221951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:17.222841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:17.225627 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 309/601] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:17.231593 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f60e21-4be0-40fb-a07e-371af20e5e77 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.289895 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178430cc-9550-436e-800a-ad37febbf818 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.336032 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.337093 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.337747 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.338230 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.347811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:17.350406 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:17.353027 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:17.359826 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f60e21-4be0-40fb-a07e-371af20e5e77 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:17.368758 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:17.369704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 293/602] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:17.371161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.402832 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.403434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.403710 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.403979 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.404634 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:17.404974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:17.406359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:17.415212 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 310/603] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:17.415973 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.463163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:17.488951 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faa73c-ed25-4ee5-9456-d1e2c28454c0 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.526790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fbc32-7c0b-4d96-a4f0-8533ba6455a6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.532904 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaa912-b3ed-4cb8-bda4-ca72a1dd5efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.533534 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaa912-b3ed-4cb8-bda4-ca72a1dd5efd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.533814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaa912-b3ed-4cb8-bda4-ca72a1dd5efd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.534084 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaa912-b3ed-4cb8-bda4-ca72a1dd5efd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.544230 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaa912-b3ed-4cb8-bda4-ca72a1dd5efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-9fdaa912-b3ed-4cb8-bda4-ca72a1dd5efd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:17.548982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:17.549984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:17.550846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 294/604] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:17.551565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaa912-b3ed-4cb8-bda4-ca72a1dd5efd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.564684 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.565291 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.565556 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.565913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.566602 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:17.566908 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:17.568346 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:17.583995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 311/605] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:17.585081 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.616633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:17.667063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaa912-b3ed-4cb8-bda4-ca72a1dd5efd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.679914 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:17.684299 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c3adf-5da3-4ed4-9012-446a8987af71 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.703871 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.704492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.704808 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.705082 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.715000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:17.716462 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:17.718779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc64d9-7a17-441e-b12d-ec2153903fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.719398 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc64d9-7a17-441e-b12d-ec2153903fba None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.719673 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc64d9-7a17-441e-b12d-ec2153903fba None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.719937 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc64d9-7a17-441e-b12d-ec2153903fba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.730016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc64d9-7a17-441e-b12d-ec2153903fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:17.731231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:17.732336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:17.733284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:17.733284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:17.733284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:17.733284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 295/606] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:17.733284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-8dcc64d9-7a17-441e-b12d-ec2153903fba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:17.734708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:17.736719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 312/607] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:17.737636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc64d9-7a17-441e-b12d-ec2153903fba None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.837321 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8df315-e68a-48c4-bd7e-3c66f01faaa2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.838604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc64d9-7a17-441e-b12d-ec2153903fba None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:17.851498 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:17.874045 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.874724 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.874954 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.875232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.875577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:17.875957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=61b8da64c241441d986c7c11f3fe2e9d) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:17.876179 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.876276 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:17.876461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.876766 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.877425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:17.877723 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:17.877820 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:17.879068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:17.883652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 313/608] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/role_assignments?user.id=61b8da64c241441d986c7c11f3fe2e9d&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:17.884458 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.887770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 296/609] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:17.889080 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.924744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.009387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9423f-ce9b-40ad-95b3-ee947e048451 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.020550 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba645-21ca-4a84-b886-089b6bc775d4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.047465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.048095 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.048378 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.048681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.049377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:18.049683 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.051110 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.059893 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 297/610] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:18.060784 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.066978 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.066978 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.066978 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.067308 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.067746 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:18.068052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.069462 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.083705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 314/611] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:18.084571 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.111447 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.183067 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.191061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db33fa2-cf83-46cc-a0d5-ab66a5ddd076 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.203336 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d77c3-d4e7-4e27-b5f0-41c40c655262 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.227088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.227831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.228111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.228387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.238331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.238973 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.239258 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.239535 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.241101 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.243036 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.250848 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.252321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:18.259132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:18.260219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:18.261194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:18.261194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:18.261194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:18.261805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 298/612] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:18.262345 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:18.270180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:18.271321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:18.272565 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:18.272565 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:18.272565 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:18.275978 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 315/613] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:18.276869 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.369191 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.383197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d584b-1dc4-4c17-977d-9defa22b567e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.383798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3cf9-944c-4e13-b09f-cccbd7622dd9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.422063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.422296 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.422688 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.422820 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.422990 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.423117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.423273 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.423368 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.423894 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:18.424196 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.425605 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.427298 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.432208 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.433945 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.440924 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 316/614] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:18.444692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:18.446605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:18.447795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 299/615] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:18.448795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.555176 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ae62f-b300-4627-91e2-db09ba6ede4b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.563816 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f55f-1037-4fe7-ad9b-39826f4f8b7a None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.591958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.592691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.593247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.593521 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.601557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.601924 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.602545 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.602827 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.603045 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.603144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.603739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:18.604044 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.605472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:18.615523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:18.616519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:18.617536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 300/616] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:18.618132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.625292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 317/617] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:18.630498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.630970 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.690420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.731549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081330d0-58c7-48b3-8d2c-99c93edb247d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.740899 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18e85-6c37-46f2-a898-ec2a1b4fca77 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.768161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.768796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.769081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.769356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.770087 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:18.770392 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.771818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.775422 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.776028 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.776308 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.776580 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.777331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:18.777638 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.779057 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.790509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 301/618] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:18.791250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.802847 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 318/619] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:18.803608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.871602 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.926430 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d1afc-8179-4aa9-87fd-4c2348e617bb None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.930254 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937412c3-2cdf-4661-b84e-9809a3d27635 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.942624 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.966937 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062548a7-1997-4fd2-a2da-732c46c5b8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.967559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062548a7-1997-4fd2-a2da-732c46c5b8e6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.967840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062548a7-1997-4fd2-a2da-732c46c5b8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.968366 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062548a7-1997-4fd2-a2da-732c46c5b8e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.974052 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.974692 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.974973 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.975245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.984744 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.986208 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:18.997937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:18.999529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 302/620] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:19.000633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.054672 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062548a7-1997-4fd2-a2da-732c46c5b8e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:19.056138 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062548a7-1997-4fd2-a2da-732c46c5b8e6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:19.114994 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d65dd8-cba3-4136-9bac-c1d41b98305c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:19.141153 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:19.153452 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9f4d6-4480-407c-8cd9-4c611ad4bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:19.154082 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f4d6-4480-407c-8cd9-4c611ad4bf70 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:19.154361 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f4d6-4480-407c-8cd9-4c611ad4bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:19.154636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f4d6-4480-407c-8cd9-4c611ad4bf70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:19.172882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 319/621] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:19.173541 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062548a7-1997-4fd2-a2da-732c46c5b8e6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.189153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:19.240471 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9f4d6-4480-407c-8cd9-4c611ad4bf70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:19.241897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9f4d6-4480-407c-8cd9-4c611ad4bf70 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:19.277126 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062548a7-1997-4fd2-a2da-732c46c5b8e6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:19.318449 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:19.319836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:19.320116 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:19.320386 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:19.321141 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:19.321441 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:19.322953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:19.350405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 320/622] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 24 09:53:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:19.350405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.357431 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 303/623] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:19.358467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9f4d6-4480-407c-8cd9-4c611ad4bf70 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.386091 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:19.428859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:19.465581 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7bc7e-06a8-4d40-a399-8f79cbf16453 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:19.485551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9f4d6-4480-407c-8cd9-4c611ad4bf70 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:19.507138 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:19.507689 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:19.507966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:19.508238 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:19.519230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:19.520702 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:19.526634 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec138-c4e1-46ad-9447-64bafde1774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:19.527307 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec138-c4e1-46ad-9447-64bafde1774d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:19.527589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec138-c4e1-46ad-9447-64bafde1774d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:19.527860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec138-c4e1-46ad-9447-64bafde1774d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:19.537511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:19.538777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:19.539825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:19.539825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:19.539825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:19.543528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 321/624] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:19.544300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.612282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfec138-c4e1-46ad-9447-64bafde1774d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:19.613812 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfec138-c4e1-46ad-9447-64bafde1774d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:19.641439 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:19.656851 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c0fcb-0571-451f-a99a-55b398f3c3c0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:19.685068 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:19.699592 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:19.700233 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:19.700510 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:19.700806 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:19.712885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:19.714359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:19.730882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:19.731897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:19.733259 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:19.733259 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:19.733259 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:19.739272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 304/625] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:19.739272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec138-c4e1-46ad-9447-64bafde1774d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.739520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 322/626] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:19.739520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.857918 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec138-c4e1-46ad-9447-64bafde1774d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:19.862274 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baca5c-c01c-4b7a-bd60-48700b311762 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:19.883929 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:19.897885 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:19.898808 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:19.899102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:19.899406 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:19.900180 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:19.900460 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:19.901826 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:19.902787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:19.903406 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:19.903682 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:19.903951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:19.904592 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:19.904921 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:19.907251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:19.918802 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 305/627] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:19.919796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.925875 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 323/628] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:19.927009 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:19.973749 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:20.051259 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8fd5-5eef-4ddf-a8c3-e6ede6df8ab5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.053065 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c366e-7230-4d12-8e6b-221e55317106 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.110292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.111165 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.111635 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.112099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.113601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e091-5080-496d-8432-371c02786206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.114823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e091-5080-496d-8432-371c02786206 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.115437 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e091-5080-496d-8432-371c02786206 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.116828 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e091-5080-496d-8432-371c02786206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.124074 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.126754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.135664 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4e091-5080-496d-8432-371c02786206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.138275 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4e091-5080-496d-8432-371c02786206 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:20.147589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:20.148604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:20.149925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:20.149925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:20.149925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:20.149925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:20.149925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:20.149925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:20.149925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:20.149925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:20.153026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 324/629] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:20.154311 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-73a4e091-5080-496d-8432-371c02786206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:20.162979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:20.164207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:20.165371 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:20.165371 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:20.165371 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:20.165961 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 306/630] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:20.168780 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e091-5080-496d-8432-371c02786206 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.208311 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:20.261352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:20.269026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83209dc6-9ac4-438d-898e-e91ff6e93eb3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.291693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e091-5080-496d-8432-371c02786206 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.303364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.303985 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.304259 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.304526 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.311175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.313220 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:20.324210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:20.325337 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 325/631] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:20.326391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.329414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fb4e5-cd7e-45a1-9b09-e2f72882d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.330115 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb4e5-cd7e-45a1-9b09-e2f72882d431 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.330685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb4e5-cd7e-45a1-9b09-e2f72882d431 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.330796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fb4e5-cd7e-45a1-9b09-e2f72882d431 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.331523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fb4e5-cd7e-45a1-9b09-e2f72882d431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:20.331894 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fb4e5-cd7e-45a1-9b09-e2f72882d431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.333409 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fb4e5-cd7e-45a1-9b09-e2f72882d431 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.346028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 307/632] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:20.347256 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd27030-25d5-40d3-b04d-6f7995f80927 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.347543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd27030-25d5-40d3-b04d-6f7995f80927 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.347823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd27030-25d5-40d3-b04d-6f7995f80927 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.349111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 308/633] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:20.349814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd27030-25d5-40d3-b04d-6f7995f80927 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.432098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cab72-9e2d-4141-a0c8-891653a9affa None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.445167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:20.453200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd27030-25d5-40d3-b04d-6f7995f80927 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.466888 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.467560 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.468092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.468376 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.469046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:20.469354 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.470722 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.482471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 326/634] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:20.483439 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.488750 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd50d9-b644-4040-860d-c2bfbb16653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.489357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd50d9-b644-4040-860d-c2bfbb16653c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.489642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd50d9-b644-4040-860d-c2bfbb16653c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.489916 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd50d9-b644-4040-860d-c2bfbb16653c None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.490606 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd50d9-b644-4040-860d-c2bfbb16653c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:20.490935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd50d9-b644-4040-860d-c2bfbb16653c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.492388 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd50d9-b644-4040-860d-c2bfbb16653c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.498687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:20.505610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 309/635] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:20.506835 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff957d-caed-4614-90eb-cedb9ea88cee None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.507120 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff957d-caed-4614-90eb-cedb9ea88cee None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.507392 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff957d-caed-4614-90eb-cedb9ea88cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.525452 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ffff957d-caed-4614-90eb-cedb9ea88cee None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:20.526659 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ffff957d-caed-4614-90eb-cedb9ea88cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:20.599893 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 310/636] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:20.600102 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef800317-8952-4509-b7cf-55c936650cbc None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.600772 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff957d-caed-4614-90eb-cedb9ea88cee None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.641896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.642505 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.642787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.643063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.643786 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=e9039bb844c14a8789c6f30e461f77c0) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:20.644159 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.645614 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.651702 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 327/637] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/role_assignments?user.id=e9039bb844c14a8789c6f30e461f77c0&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:20.661778 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.700206 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:20.720822 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff957d-caed-4614-90eb-cedb9ea88cee None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.758068 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:20.766145 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.767315 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.767836 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.768341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.776900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.778846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.783691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab52524-96f1-4433-a928-42ff94a3380b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:20.792713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:20.793717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:20.794667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:20.794667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:20.794667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:20.794667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:20.794667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:20.794667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:20.794667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:20.794667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:20.797890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 311/638] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:20.808723 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.823368 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.824101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.824376 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.824645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.825765 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=b7495e57630d4978a2a5c1681b8578c4) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:20.825880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.827971 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:20.835711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 328/639] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/role_assignments?user.id=b7495e57630d4978a2a5c1681b8578c4&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:20.948386 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd4201-a4f2-4328-9171-eed06b1678b3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:20.950309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.991017 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:20.991849 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.992046 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.992299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.993049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:20.993432 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:20.994815 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:21.008982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 312/640] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:21.020689 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:21.029796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:21.102658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdba8e9-c478-4b50-a5d7-db4559995509 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:21.173589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ab55-d46b-4486-853e-36c8849b85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:21.174569 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ab55-d46b-4486-853e-36c8849b85e5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:21.175453 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ab55-d46b-4486-853e-36c8849b85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:21.175833 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ab55-d46b-4486-853e-36c8849b85e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:21.181447 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb67db-ef3f-4fad-ab2b-f0b9633f0a11 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:21.192188 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4ab55-d46b-4486-853e-36c8849b85e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-06b4ab55-d46b-4486-853e-36c8849b85e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:21.197671 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:21.198930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:53:21.200100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:21.202544 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 329/641] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:21.207864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ab55-d46b-4486-853e-36c8849b85e5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:21.216992 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:21.226611 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:21.227426 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:21.227879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:21.228301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:21.229210 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=7712bef2122745c3b05aad9e4dff7c12) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:21.229667 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:21.231306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:21.238317 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 313/642] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:21 2022] GET /identity/v3/role_assignments?user.id=7712bef2122745c3b05aad9e4dff7c12&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:21.324917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ab55-d46b-4486-853e-36c8849b85e5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:21.372932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:21.374275 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:21.374655 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:21.375026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:21.375820 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:21.376223 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:21.377769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:21.395007 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 330/643] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:21.401899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:21.509871 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:21.546312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa95fc-b29e-457a-bffb-91b87e3951e6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:21.582115 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:21.582913 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:21.583294 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:21.583657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:21.595536 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:21.597166 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:21.612173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:21.613404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:21.614524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:21.614524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:21.614524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:21.617922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 314/644] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:21.621360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:21.691069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:21.736824 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb65b1b-ffe3-4824-83ea-e9169cab7489 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:21.772766 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:21.776694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:21.776694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:21.776694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:21.776694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:21.776694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:21.776694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:21.789295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 331/645] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:21.794757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:21.945884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd9e8-4a11-4a51-803e-9b190ae87478 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:21.977039 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:21.989809 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:21.990906 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:21.991460 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:21.991994 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.004281 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.006314 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:22.022860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:22.023890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:22.025479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 315/646] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 09:53:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:22.030488 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.151127 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e726-3c17-4520-ac77-978384983186 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.177439 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:22.188644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.189357 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.189699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.190034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.190819 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:22.191191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.192772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.211215 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 332/647] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:22.216673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.328004 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934e7d-b631-4626-b5c8-070da9d6ada3 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.367693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713478e-578b-424b-a71b-71c06d6481b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.368427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713478e-578b-424b-a71b-71c06d6481b7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.368818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713478e-578b-424b-a71b-71c06d6481b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.369164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713478e-578b-424b-a71b-71c06d6481b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.422791 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:22.444690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713478e-578b-424b-a71b-71c06d6481b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.446279 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713478e-578b-424b-a71b-71c06d6481b7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.554808 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 316/648] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:22.561747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.675597 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dc9f6-c14f-48a3-8998-2e414ad59085 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.714067 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.714707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.714990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.715267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.727401 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.728960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:22.745711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:22.746740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:22.748289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:22.748289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:22.748289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:22.748289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 333/649] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:22.754080 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713478e-578b-424b-a71b-71c06d6481b7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.857322 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:22.889423 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713478e-578b-424b-a71b-71c06d6481b7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.953706 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.954707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.955199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.955766 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.956633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:22.957397 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.960228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.982880 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 317/650] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:22.992929 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.037415 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:23.119832 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb904e69-b54b-46fe-b68b-3dfce01ba222 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:23.156404 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aed3b-4d5f-4bce-b2e5-dcd12a18f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:23.157075 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aed3b-4d5f-4bce-b2e5-dcd12a18f944 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.157356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aed3b-4d5f-4bce-b2e5-dcd12a18f944 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.157634 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aed3b-4d5f-4bce-b2e5-dcd12a18f944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.164890 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aed3b-4d5f-4bce-b2e5-dcd12a18f944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:23.166355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aed3b-4d5f-4bce-b2e5-dcd12a18f944 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a74aed3b-4d5f-4bce-b2e5-dcd12a18f944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:23.178729 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:23.181100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:23.183210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 334/651] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:23.188790 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.231966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be8a7b-e754-494c-9c91-18992327378f None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.231966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be8a7b-e754-494c-9c91-18992327378f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.231966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be8a7b-e754-494c-9c91-18992327378f None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.233651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 335/652] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:23.239688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055e43-7bcc-44c4-bfcd-343f39b53a04 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.240341 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055e43-7bcc-44c4-bfcd-343f39b53a04 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.240877 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055e43-7bcc-44c4-bfcd-343f39b53a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.261865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-59055e43-7bcc-44c4-bfcd-343f39b53a04 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:23.264690 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-59055e43-7bcc-44c4-bfcd-343f39b53a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:23.299333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ce837-9fe8-4af3-a6be-0ed1d5e5ba2b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:23.337189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:23.337821 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.338102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.338544 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.339247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:23.339552 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:23.341085 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:23.360817 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 318/653] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:23.362980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.366088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:23.392023 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 336/654] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:23.398777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8eec-69fd-49e1-ac19-14a857fe0c91 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.399061 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8eec-69fd-49e1-ac19-14a857fe0c91 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.399336 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8eec-69fd-49e1-ac19-14a857fe0c91 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.404832 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 337/655] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:23.406638 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e87b0-cf3e-431e-b3ff-57c46160ae01 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.406928 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e87b0-cf3e-431e-b3ff-57c46160ae01 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.407206 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e87b0-cf3e-431e-b3ff-57c46160ae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.426474 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fd0e87b0-cf3e-431e-b3ff-57c46160ae01 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:23.427676 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fd0e87b0-cf3e-431e-b3ff-57c46160ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:23.446609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:23.497852 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90084e8-44bf-4c04-a66f-2242cff5ae64 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:23.505094 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 338/656] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:23.540042 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:23.541154 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.541699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.542200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.543291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=61b8da64c241441d986c7c11f3fe2e9d) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:23.544011 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:23.546530 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:23.553152 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 319/657] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:23 2022] GET /identity/v3/role_assignments?user.id=61b8da64c241441d986c7c11f3fe2e9d&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:23.751401 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e87b0-cf3e-431e-b3ff-57c46160ae01 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.837836 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.885253 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e87b0-cf3e-431e-b3ff-57c46160ae01 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:23.925922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9f1c-4fd8-4bca-a480-6d40375d4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:23.926819 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9f1c-4fd8-4bca-a480-6d40375d4e58 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.927270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9f1c-4fd8-4bca-a480-6d40375d4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.927715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9f1c-4fd8-4bca-a480-6d40375d4e58 None admin] PATH_INFO: `/v3/services/image` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.928694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9f1c-4fd8-4bca-a480-6d40375d4e58 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:23.930656 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:23.930887 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9f1c-4fd8-4bca-a480-6d40375d4e58 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-8dfc9f1c-4fd8-4bca-a480-6d40375d4e58 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:23.948158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:23.949303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:23.950186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 339/658] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 24 09:53:23 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:23.952611 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a584-15ab-43a8-b6f8-f290ced60e3e None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.952854 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a584-15ab-43a8-b6f8-f290ced60e3e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.953287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a584-15ab-43a8-b6f8-f290ced60e3e None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.960722 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 340/659] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:23.960722 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a584-15ab-43a8-b6f8-f290ced60e3e None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.981796 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:23.990685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9601e8c-ddf3-4d37-a659-00cd1583b116 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.028130 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e969b00-c0c7-401a-bfe1-c1e4cf8e709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.028706 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969b00-c0c7-401a-bfe1-c1e4cf8e709c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.028998 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969b00-c0c7-401a-bfe1-c1e4cf8e709c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.029278 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969b00-c0c7-401a-bfe1-c1e4cf8e709c None admin] PATH_INFO: `/v3/services/network` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.029918 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e969b00-c0c7-401a-bfe1-c1e4cf8e709c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.031806 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e969b00-c0c7-401a-bfe1-c1e4cf8e709c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-7e969b00-c0c7-401a-bfe1-c1e4cf8e709c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:24.043673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:24.049657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:24.050549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 320/660] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:23 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:24.051375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49ef59-13b8-4fc2-b158-9bfc5c5437cc None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.051375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49ef59-13b8-4fc2-b158-9bfc5c5437cc None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.051375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49ef59-13b8-4fc2-b158-9bfc5c5437cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.068430 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-5d49ef59-13b8-4fc2-b158-9bfc5c5437cc None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:24.069688 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-5d49ef59-13b8-4fc2-b158-9bfc5c5437cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:24.090175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a584-15ab-43a8-b6f8-f290ced60e3e None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.132002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.132756 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.133091 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.133544 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.134242 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] RBAC: Adding query filter params (name=image) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:24.134614 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.136098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.142157 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 341/661] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:24.142986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:24.160695 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 321/662] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:24.160695 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49ef59-13b8-4fc2-b158-9bfc5c5437cc None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:24.227891 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:24.243266 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:24.265404 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bcdc-bf20-44c9-9780-79b0b5c46eff None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.281722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49ef59-13b8-4fc2-b158-9bfc5c5437cc None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.309806 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.311761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.312521 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.313369 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.314424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] RBAC: Adding query filter params (name=network) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:24.315283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.317054 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.321549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.322162 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.322448 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.322723 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.323372 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] RBAC: Adding query filter params (type=image) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:24.323681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.324119 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 342/663] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:24.331590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.331769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:24.336768 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 322/664] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:24.459212 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e13f9e-6000-4e2c-8c90-9e09898d4da5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.501502 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.502137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.502414 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.502686 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.503335 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] RBAC: Adding query filter params (type=network) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:24.503635 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.505084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.512086 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 343/665] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:24.520141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:24.647102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a04df-595c-421f-8e43-1e666ce3bac1 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.676905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:24.694160 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.695252 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.695731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.696199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.697023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.698729 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:24.708731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:24.709798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:24.710649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 323/666] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 24 09:53:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:24.715723 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:24.730215 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:24.850300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2b40d-5138-4f15-94ef-37331f412018 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.887164 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba68b52-66d0-4a6b-a34c-4cb9cbd1d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.888057 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba68b52-66d0-4a6b-a34c-4cb9cbd1d347 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.888500 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba68b52-66d0-4a6b-a34c-4cb9cbd1d347 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.888952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba68b52-66d0-4a6b-a34c-4cb9cbd1d347 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.889790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba68b52-66d0-4a6b-a34c-4cb9cbd1d347 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:24.890235 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba68b52-66d0-4a6b-a34c-4cb9cbd1d347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.891750 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba68b52-66d0-4a6b-a34c-4cb9cbd1d347 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.900858 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 344/667] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 09:53:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:24.903282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:25.019969 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d35a62-aaf4-4309-a50c-01c8019698f9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:25.056623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bd916-dc55-49ea-8fd0-8546395a19db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:25.057257 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd916-dc55-49ea-8fd0-8546395a19db None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:25.057535 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd916-dc55-49ea-8fd0-8546395a19db None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:25.057806 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd916-dc55-49ea-8fd0-8546395a19db None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:25.058432 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bd916-dc55-49ea-8fd0-8546395a19db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:25.058737 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bd916-dc55-49ea-8fd0-8546395a19db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:25.060220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bd916-dc55-49ea-8fd0-8546395a19db None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:25.065755 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 324/668] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 09:53:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:25.910522 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101747b7-4064-431b-b2fc-85da046e20da None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:25.910961 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101747b7-4064-431b-b2fc-85da046e20da None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:25.911055 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101747b7-4064-431b-b2fc-85da046e20da None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:25.912566 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 345/669] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:25.917972 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2bede-39a2-4341-8a38-5d8e17349323 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:25.918389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2bede-39a2-4341-8a38-5d8e17349323 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:25.918566 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2bede-39a2-4341-8a38-5d8e17349323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:25.936922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-f9a2bede-39a2-4341-8a38-5d8e17349323 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:25.938111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-f9a2bede-39a2-4341-8a38-5d8e17349323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:25.990005 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:26.013989 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 325/670] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:26.359215 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101747b7-4064-431b-b2fc-85da046e20da None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:26.448412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:26.477361 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101747b7-4064-431b-b2fc-85da046e20da None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:26.514071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b147cc-d722-45d8-9997-ac21ce756c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:26.515348 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b147cc-d722-45d8-9997-ac21ce756c37 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.515641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b147cc-d722-45d8-9997-ac21ce756c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.515915 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b147cc-d722-45d8-9997-ac21ce756c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.527124 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b147cc-d722-45d8-9997-ac21ce756c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a6b147cc-d722-45d8-9997-ac21ce756c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:26.533342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:26.535481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:26.536735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 346/671] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:53:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:26.541762 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2bede-39a2-4341-8a38-5d8e17349323 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:26.662658 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2bede-39a2-4341-8a38-5d8e17349323 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:26.706031 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3460e-c978-4868-aa86-8df2718ae79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:26.706589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3460e-c978-4868-aa86-8df2718ae79b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.706589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3460e-c978-4868-aa86-8df2718ae79b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.706957 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3460e-c978-4868-aa86-8df2718ae79b None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.708693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3460e-c978-4868-aa86-8df2718ae79b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:26.708693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3460e-c978-4868-aa86-8df2718ae79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:26.709256 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3460e-c978-4868-aa86-8df2718ae79b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:26.719146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 326/672] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:26.726386 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b147cc-d722-45d8-9997-ac21ce756c37 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:26.746029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043f8f-8698-470c-8e0f-a6b81cc9e14a None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.746324 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043f8f-8698-470c-8e0f-a6b81cc9e14a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.746610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043f8f-8698-470c-8e0f-a6b81cc9e14a None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.748253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 327/673] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:26.754488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156b5f-1228-42e2-a59d-0835a8b738bb None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.754836 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156b5f-1228-42e2-a59d-0835a8b738bb None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.755061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156b5f-1228-42e2-a59d-0835a8b738bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.782722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-71156b5f-1228-42e2-a59d-0835a8b738bb None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:26.784214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-71156b5f-1228-42e2-a59d-0835a8b738bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:26.863712 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:26.896947 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b147cc-d722-45d8-9997-ac21ce756c37 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:26.924519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 328/674] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:26.944870 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84160c-9a59-4608-a369-4db0c5cae8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:26.946218 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84160c-9a59-4608-a369-4db0c5cae8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.946697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84160c-9a59-4608-a369-4db0c5cae8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.947184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84160c-9a59-4608-a369-4db0c5cae8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.949557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:26.960139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84160c-9a59-4608-a369-4db0c5cae8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:26.962011 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84160c-9a59-4608-a369-4db0c5cae8f7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-5a84160c-9a59-4608-a369-4db0c5cae8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:26.977946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:26.978980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:26.979892 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:26.979892 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:26.979892 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:26.982080 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 347/675] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:26.988998 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf1a9-2151-45f2-8477-e22ea79860dd None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.989174 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156b5f-1228-42e2-a59d-0835a8b738bb None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:26.989714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf1a9-2151-45f2-8477-e22ea79860dd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.990207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf1a9-2151-45f2-8477-e22ea79860dd None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.992002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 348/676] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:26.999715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485bf5-f9ab-4668-a47a-538a629d8de2 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.000125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485bf5-f9ab-4668-a47a-538a629d8de2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.000545 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485bf5-f9ab-4668-a47a-538a629d8de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.026389 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e4485bf5-f9ab-4668-a47a-538a629d8de2 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:27.028444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e4485bf5-f9ab-4668-a47a-538a629d8de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:27.127382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156b5f-1228-42e2-a59d-0835a8b738bb None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:27.128221 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 349/677] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:53:27.170058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:27.171609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.172090 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.172559 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.173455 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:27.173967 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:27.175583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:27.188634 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 329/678] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:27.195050 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485bf5-f9ab-4668-a47a-538a629d8de2 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:27.270669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:27.309605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:27.319513 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485bf5-f9ab-4668-a47a-538a629d8de2 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:27.353117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:27.369029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:27.370409 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.370841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.371504 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.385946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:27.388390 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:27.397439 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ba41f-ccb5-4fac-93cf-439b992e7106 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:27.404352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:27.406370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:27.407517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:27.414547 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 350/679] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 09:53:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:27.415626 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:27.450894 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5479641-4c3f-4879-8c46-52bdec5e6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:27.452291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479641-4c3f-4879-8c46-52bdec5e6ae5 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.452622 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479641-4c3f-4879-8c46-52bdec5e6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.453102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479641-4c3f-4879-8c46-52bdec5e6ae5 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.453771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5479641-4c3f-4879-8c46-52bdec5e6ae5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:27.455211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5479641-4c3f-4879-8c46-52bdec5e6ae5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:27.484695 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 330/680] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:53:27 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:53:27.484695 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fde32-6d74-47cd-b999-0e602b7cfe8f None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.484695 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fde32-6d74-47cd-b999-0e602b7cfe8f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.484695 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fde32-6d74-47cd-b999-0e602b7cfe8f None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.484695 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 331/681] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:27.490225 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e02c6-1c11-43e3-a1c4-b74da3291a60 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.490509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e02c6-1c11-43e3-a1c4-b74da3291a60 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.490779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e02c6-1c11-43e3-a1c4-b74da3291a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.521487 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6d6e02c6-1c11-43e3-a1c4-b74da3291a60 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:27.522821 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6d6e02c6-1c11-43e3-a1c4-b74da3291a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:27.573079 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ded7-d042-47ee-b3f9-0c52294e1ad9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:27.633779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:27.634803 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.635328 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.635809 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.636853 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:27.637401 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:27.637688 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 332/682] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:27 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:27.639636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e02c6-1c11-43e3-a1c4-b74da3291a60 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:27.640115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:27.669631 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 351/683] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 09:53:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:27.671012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:27.700188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:27.732188 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:27.811626 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e02c6-1c11-43e3-a1c4-b74da3291a60 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:27.860341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63388bca-1f13-41b6-a8bb-4ffb6a6c9c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:27.861116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388bca-1f13-41b6-a8bb-4ffb6a6c9c2a None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.861392 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388bca-1f13-41b6-a8bb-4ffb6a6c9c2a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.861706 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388bca-1f13-41b6-a8bb-4ffb6a6c9c2a None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.862360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63388bca-1f13-41b6-a8bb-4ffb6a6c9c2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:27.863807 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63388bca-1f13-41b6-a8bb-4ffb6a6c9c2a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:27.868045 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24729d82-5971-473b-9b84-20173de42de4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:27.884691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 333/684] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:53:27 2022] POST /identity/v3/services => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:27.930444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:27.931551 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.932039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.932513 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.947052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:27.949576 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:27.969483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:27.970739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:27.971899 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:27.971899 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:27.971899 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:27.974208 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 352/685] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:27.984952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63388bca-1f13-41b6-a8bb-4ffb6a6c9c2a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:28.103164 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:28.107793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:28.132164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63388bca-1f13-41b6-a8bb-4ffb6a6c9c2a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:28.181517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:28.182161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:28.182454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:28.182751 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:28.183377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:28.183689 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:28.186930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:28.200868 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 334/686] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:28.207062 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:28.230019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:28.277707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e34e8-e390-49dc-a603-6134ade76978 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:28.333893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f5ee5-84a2-4bd4-9afa-c4471c538c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:28.334975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5ee5-84a2-4bd4-9afa-c4471c538c24 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:28.335515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5ee5-84a2-4bd4-9afa-c4471c538c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:28.335986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5ee5-84a2-4bd4-9afa-c4471c538c24 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:28.336889 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f5ee5-84a2-4bd4-9afa-c4471c538c24 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:28.338589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f5ee5-84a2-4bd4-9afa-c4471c538c24 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:28.362355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 353/687] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:53:28 2022] POST /identity/v3/services => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:53:28.364813 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc08f7-c05b-4b68-8456-d4b39e01c81b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:28.435818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:28.437092 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:28.437436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:28.437710 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:28.445844 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:28.447366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:28.450624 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:28.460884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:28.461939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:28.462876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:28.462876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:28.462876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:28.462876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:28.462876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:28.462876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:28.462876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:28.462876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:28.466192 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 335/688] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:28.472261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f5ee5-84a2-4bd4-9afa-c4471c538c24 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:28.631872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f5ee5-84a2-4bd4-9afa-c4471c538c24 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:28.675805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a21c5-7241-47a4-bee2-b2074d540ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:28.676865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a21c5-7241-47a4-bee2-b2074d540ae1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:28.677376 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a21c5-7241-47a4-bee2-b2074d540ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:28.677864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a21c5-7241-47a4-bee2-b2074d540ae1 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:28.678845 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a21c5-7241-47a4-bee2-b2074d540ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:28.679364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a21c5-7241-47a4-bee2-b2074d540ae1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:28.681087 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a21c5-7241-47a4-bee2-b2074d540ae1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:28.696169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 354/689] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:28.697043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:28.705900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:28.853599 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622164-3819-482d-a4ed-5eda27c25f32 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:28.894218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c5d39-1434-48a6-b9ad-92cb985735dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:28.895261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5d39-1434-48a6-b9ad-92cb985735dc None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:28.895765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5d39-1434-48a6-b9ad-92cb985735dc None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:28.896252 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5d39-1434-48a6-b9ad-92cb985735dc None admin] PATH_INFO: `/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/61b8da64c241441d986c7c11f3fe2e9d/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:28.898806 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c5d39-1434-48a6-b9ad-92cb985735dc None admin] RBAC: Authorizing `identity:create_grant(project_id=e64d42bc4e7840c194ea6c42c4b1be8e, user_id=61b8da64c241441d986c7c11f3fe2e9d, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:28.900852 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c5d39-1434-48a6-b9ad-92cb985735dc None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:28.923264 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 336/690] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:53:28 2022] PUT /identity/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/61b8da64c241441d986c7c11f3fe2e9d/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:29.948625 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118746-8021-47c0-a572-0c9f47407629 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:29.949886 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118746-8021-47c0-a572-0c9f47407629 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:29.950411 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e118746-8021-47c0-a572-0c9f47407629 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:29.952564 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 355/691] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:29.958996 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e86a5-8b2b-4b36-a7b2-0ed6af6c9cda None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:29.960033 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e86a5-8b2b-4b36-a7b2-0ed6af6c9cda None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:29.960518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e86a5-8b2b-4b36-a7b2-0ed6af6c9cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:30.105982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-dd2e86a5-8b2b-4b36-a7b2-0ed6af6c9cda None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:30.107474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-dd2e86a5-8b2b-4b36-a7b2-0ed6af6c9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:30.193253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:30.208100 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 337/692] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:30.477182 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccbbe7-58ad-4a4f-ae13-c0f64b9064c4 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:30.477376 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccbbe7-58ad-4a4f-ae13-c0f64b9064c4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:30.477676 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccbbe7-58ad-4a4f-ae13-c0f64b9064c4 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:30.479270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 356/693] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:30.485960 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c5167-18f2-413b-a043-34b27c44cbee None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:30.486442 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c5167-18f2-413b-a043-34b27c44cbee None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:30.487004 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c5167-18f2-413b-a043-34b27c44cbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:30.517518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-540c5167-18f2-413b-a043-34b27c44cbee None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:30.519342 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-540c5167-18f2-413b-a043-34b27c44cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:30.550886 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccbbe7-58ad-4a4f-ae13-c0f64b9064c4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:30.603583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 338/694] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:30.677628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccbbe7-58ad-4a4f-ae13-c0f64b9064c4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:30.720232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:30.720898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:30.721251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:30.721498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] PATH_INFO: `/v3/services/image` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:30.722084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:30.723507 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:30.733262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:30.734359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:30.735286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 357/695] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 24 09:53:30 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:30.742860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c5167-18f2-413b-a043-34b27c44cbee None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:30.858877 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c5167-18f2-413b-a043-34b27c44cbee None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:30.881154 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:30.897232 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:30.897852 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:30.898131 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:30.898403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:30.899042 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] RBAC: Adding query filter params (name=image) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:30.899343 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:30.900742 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:30.906423 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 339/696] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:30.912774 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:30.972247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:30.983509 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:31.034033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d5cef-fde8-4910-bbd8-1f21290f17c8 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.088590 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:31.089290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.089578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.089850 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.090498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] RBAC: Adding query filter params (type=image) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:31.090802 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:31.092379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:31.098917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 358/697] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:31.104218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f23bb8-6d3a-4b14-94fa-6048e9a4d17a None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.105085 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:31.142658 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:31.143280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.143562 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.143837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] PATH_INFO: `/v3/services/network` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.144420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:31.145836 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:31.155113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:31.156202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:31.157157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 340/698] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:30 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:31.162424 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:31.215231 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:31.226968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0584d1-1952-4447-bd80-6672670bebb7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.257722 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:31.267968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf16f6-bb49-49ac-8f23-9c529fe211ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:31.268588 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf16f6-bb49-49ac-8f23-9c529fe211ba None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.268900 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf16f6-bb49-49ac-8f23-9c529fe211ba None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.269173 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf16f6-bb49-49ac-8f23-9c529fe211ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.269876 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf16f6-bb49-49ac-8f23-9c529fe211ba None admin] RBAC: Adding query filter params (interface=public, service_id=f4b1046e63234610a2a1c4bf090e9256, region_id=RegionOne) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:31.270181 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf16f6-bb49-49ac-8f23-9c529fe211ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:31.271553 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf16f6-bb49-49ac-8f23-9c529fe211ba None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:31.272083 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10789f0e-144b-4cbc-9289-f7b085c9407b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.279245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 359/699] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 09:53:31 2022] GET /identity/v3/endpoints?service_id=f4b1046e63234610a2a1c4bf090e9256&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:31.280498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67172e5-14bb-46a3-8d58-2d3a66ff6275 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.280817 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67172e5-14bb-46a3-8d58-2d3a66ff6275 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.281097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67172e5-14bb-46a3-8d58-2d3a66ff6275 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.282569 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 360/700] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:31.284560 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67172e5-14bb-46a3-8d58-2d3a66ff6275 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:31.316537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bb94b-b203-4017-b4d8-56b9b35ce629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:31.317318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb94b-b203-4017-b4d8-56b9b35ce629 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.317599 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb94b-b203-4017-b4d8-56b9b35ce629 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.317896 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bb94b-b203-4017-b4d8-56b9b35ce629 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.318610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bb94b-b203-4017-b4d8-56b9b35ce629 None admin] RBAC: Adding query filter params (name=network) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:31.318917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bb94b-b203-4017-b4d8-56b9b35ce629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:31.320272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bb94b-b203-4017-b4d8-56b9b35ce629 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:31.328718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 341/701] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:31.328718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c04c-c5a1-4814-bf61-fc9ea6ff8c22 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.328718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c04c-c5a1-4814-bf61-fc9ea6ff8c22 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.328718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c04c-c5a1-4814-bf61-fc9ea6ff8c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.346300 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c0f3c04c-c5a1-4814-bf61-fc9ea6ff8c22 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:31.347549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c0f3c04c-c5a1-4814-bf61-fc9ea6ff8c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:31.399434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67172e5-14bb-46a3-8d58-2d3a66ff6275 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.421312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 342/702] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:31.422192 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c04c-c5a1-4814-bf61-fc9ea6ff8c22 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:31.450691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba6b64-3780-4058-9149-0e4c9c98ecc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:31.451999 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6b64-3780-4058-9149-0e4c9c98ecc7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.452516 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6b64-3780-4058-9149-0e4c9c98ecc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.453422 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6b64-3780-4058-9149-0e4c9c98ecc7 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.454498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba6b64-3780-4058-9149-0e4c9c98ecc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:31.456824 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba6b64-3780-4058-9149-0e4c9c98ecc7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:31.465541 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 361/703] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 09:53:31 2022] GET /identity/v3/services => generated 1002 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:53:31.477981 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:31.558327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c04c-c5a1-4814-bf61-fc9ea6ff8c22 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.605355 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3ac8d-66c5-4a3e-8629-93b80cb29b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:31.606089 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3ac8d-66c5-4a3e-8629-93b80cb29b17 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.606374 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3ac8d-66c5-4a3e-8629-93b80cb29b17 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.606784 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3ac8d-66c5-4a3e-8629-93b80cb29b17 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.607463 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3ac8d-66c5-4a3e-8629-93b80cb29b17 None admin] RBAC: Adding query filter params (type=network) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:31.607898 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3ac8d-66c5-4a3e-8629-93b80cb29b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:31.610074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3ac8d-66c5-4a3e-8629-93b80cb29b17 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:31.616530 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 343/704] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:31.622867 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba6b64-3780-4058-9149-0e4c9c98ecc7 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:31.692720 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:31.711830 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41f01-0af7-4789-9bf4-8e11c7995c4b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.712156 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41f01-0af7-4789-9bf4-8e11c7995c4b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.712379 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41f01-0af7-4789-9bf4-8e11c7995c4b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.713886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 344/705] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:31.720345 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553f839-6b37-46bd-b102-3e246125aa92 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.721004 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553f839-6b37-46bd-b102-3e246125aa92 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.721503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553f839-6b37-46bd-b102-3e246125aa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.741498 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c553f839-6b37-46bd-b102-3e246125aa92 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:31.743328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c553f839-6b37-46bd-b102-3e246125aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:31.749453 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba6b64-3780-4058-9149-0e4c9c98ecc7 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.786509 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:31.787139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.787421 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.787698 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:31.788408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] RBAC: Adding query filter params (interface=public, service_id=7e1e130a2a1a4606a1d56ec57039370b, region_id=RegionOne) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:31.788750 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:31.790209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:31.796507 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 362/706] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 09:53:31 2022] GET /identity/v3/endpoints?service_id=7e1e130a2a1a4606a1d56ec57039370b&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:31.797380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:31.844686 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 345/707] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:31.844686 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553f839-6b37-46bd-b102-3e246125aa92 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:31.891033 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:31.942442 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae2ad-d12a-4672-8e4a-8efe5e005fa2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.973022 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553f839-6b37-46bd-b102-3e246125aa92 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:31.981135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:31.990772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bce68-66f1-4cfb-b16c-f9b1a2a24679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:31.991522 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bce68-66f1-4cfb-b16c-f9b1a2a24679 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:31.991845 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bce68-66f1-4cfb-b16c-f9b1a2a24679 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:31.992190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bce68-66f1-4cfb-b16c-f9b1a2a24679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.006768 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bce68-66f1-4cfb-b16c-f9b1a2a24679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-255bce68-66f1-4cfb-b16c-f9b1a2a24679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:53:32.015665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:32.016764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:53:32.017644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:32.018326 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 363/708] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:32.022596 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb18b54-1ca2-40c1-9c00-17c55f9be011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:32.022921 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18b54-1ca2-40c1-9c00-17c55f9be011 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.023232 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18b54-1ca2-40c1-9c00-17c55f9be011 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.023439 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bce68-66f1-4cfb-b16c-f9b1a2a24679 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.023544 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18b54-1ca2-40c1-9c00-17c55f9be011 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.024228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb18b54-1ca2-40c1-9c00-17c55f9be011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:32.026042 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb18b54-1ca2-40c1-9c00-17c55f9be011 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:32.033327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 346/709] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 09:53:31 2022] GET /identity/v3/services => generated 1002 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:32.153362 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bce68-66f1-4cfb-b16c-f9b1a2a24679 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:32.198185 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb18b54-1ca2-40c1-9c00-17c55f9be011 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.200168 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:32.200840 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.201120 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.201393 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.202631 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:32.202937 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:32.204391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:32.218803 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 364/710] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:32.222453 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.278304 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.354331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a0b24-acd5-493d-8df5-2d9a4102608b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:32.356618 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb18b54-1ca2-40c1-9c00-17c55f9be011 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:32.368390 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.402882 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:32.403111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:32.403760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.403959 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.404237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.405329 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.405864 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.406368 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.407222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:32.408911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:32.417499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:32.418994 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:32.419900 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:32.421024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:32.421933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:32.429762 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 347/711] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:32.431243 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:32.438006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:32.439146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:32.440069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:32.440069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:32.440069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:32.440069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 365/712] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:32.445799 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.551564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f346d-8ad6-4f2f-98b0-b39b3f586737 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:32.583790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.603674 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab939e-766c-466e-917d-a71dcec2010d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:32.610464 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:32.611414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.611823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.612289 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.613252 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:32.613708 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:32.615884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:32.622439 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 348/713] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:32.630150 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.666858 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:32.667392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.667676 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.667954 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.668747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:32.669060 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:32.671104 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:32.682485 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.688145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 366/714] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:32.696892 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.781588 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533ec0b-097e-436d-a8f4-97340a3562f7 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:32.839699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:32.840321 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.840627 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.840962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.841892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:32.842225 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:32.845161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:32.858612 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 349/715] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:32.865274 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.877977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b608bdc-ae03-40e7-9a0c-6116e702bb17 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:32.930217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:32.930775 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.931053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.931327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.942569 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:32.945112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:32.961261 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:32.962370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:53:32.963606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:32.968715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 367/716] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:32.970482 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.996606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:33.021938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:33.037193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7b36e-9fa2-481a-b52a-0f1349020c79 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:33.095686 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:33.096272 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:33.096850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:33.097217 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:33.098548 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] RBAC: Adding query filter params (interface=public, service_id=8f4fb6a931db468ab85b52d8a7545395, region_id=RegionOne) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:33.098972 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:33.101296 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:33.121125 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 350/717] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/endpoints?service_id=8f4fb6a931db468ab85b52d8a7545395&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:33.122678 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:33.133600 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9805c3b-976b-4225-a267-5bb49a82f0c9 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:33.173115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:33.174111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:33.174596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:33.175084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:33.176020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:33.176528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:33.178240 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:33.198962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 368/718] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:33.205509 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:33.274934 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5462c-7b13-4ab1-8490-9b24c41fc90b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:33.326018 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:33.326291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310519d-7add-4394-8b75-4eb180b590fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:33.327705 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310519d-7add-4394-8b75-4eb180b590fa None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:33.328232 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310519d-7add-4394-8b75-4eb180b590fa None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:33.328647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310519d-7add-4394-8b75-4eb180b590fa None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:33.330343 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310519d-7add-4394-8b75-4eb180b590fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:33.331886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310519d-7add-4394-8b75-4eb180b590fa None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:33.347564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 351/719] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 09:53:33 2022] GET /identity/v3/services => generated 1002 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:33.372923 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99599a28-8b38-484d-9db4-761734eb9330 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:33.419726 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6a8d6-9a6a-41b0-96e0-fbd60790de17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:33.420588 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6a8d6-9a6a-41b0-96e0-fbd60790de17 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:33.420721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6a8d6-9a6a-41b0-96e0-fbd60790de17 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:33.420998 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6a8d6-9a6a-41b0-96e0-fbd60790de17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:33.509675 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6a8d6-9a6a-41b0-96e0-fbd60790de17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:33.511276 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6a8d6-9a6a-41b0-96e0-fbd60790de17 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:33.618862 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:33.663438 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 369/720] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:33 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:53:33.665539 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310519d-7add-4394-8b75-4eb180b590fa None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:33.696590 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:33.808871 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310519d-7add-4394-8b75-4eb180b590fa None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:33.838733 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b267e3-7628-42a6-bd66-8ae21403a7ac None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:33.839047 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b267e3-7628-42a6-bd66-8ae21403a7ac None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:33.841582 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b267e3-7628-42a6-bd66-8ae21403a7ac None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:33.841944 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 370/721] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:33.848707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c192-fe4f-4616-98ac-a6a24cebe8b3 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:33.849071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c192-fe4f-4616-98ac-a6a24cebe8b3 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:33.849315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7c192-fe4f-4616-98ac-a6a24cebe8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:33.859181 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:33.860180 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:33.860722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:33.861218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:33.873062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-28a7c192-fe4f-4616-98ac-a6a24cebe8b3 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:33.874507 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:33.874988 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-28a7c192-fe4f-4616-98ac-a6a24cebe8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:33.876426 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:33.892777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:33.893823 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:33.894757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:33.894757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:33.894757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:33.897170 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 352/722] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:33.904252 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:33.989202 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 371/723] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:53:34.017239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:34.051481 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a52be-e740-4776-a2d6-e0c5e02ea22e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:34.101470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:34.102684 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:34.103250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:34.103757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:34.104844 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:34.105492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:34.107228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:34.127075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 353/724] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:34.132640 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7c192-fe4f-4616-98ac-a6a24cebe8b3 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:34.256893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:34.259926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7c192-fe4f-4616-98ac-a6a24cebe8b3 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:34.298245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:34.298881 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:34.299162 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:34.299435 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:34.306862 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:34.308326 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:34.320145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:34.321477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:34.322639 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 372/725] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:34.330650 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:34.391945 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:34.466017 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d367583-5e66-455f-9d1e-cb95593dc23b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:34.504987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4c794-4e25-4327-bbee-ab9ae4d4845d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:34.511093 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:34.516803 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:34.518291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:34.518881 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:34.519487 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:34.520704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:34.521368 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:34.524152 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:34.544168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 354/726] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:34.552805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:34.552805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:34.552805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:34.552805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] PATH_INFO: `/v3/services/image` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:34.553271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:34.553271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:34.553457 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:34.559805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:34.561518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:34.562412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 373/727] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 24 09:53:34 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:34.567723 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:34.598541 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:34.710365 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999d6ab-1b65-4ffd-9f35-bebb595f28ef None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:34.731324 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece74b-61d8-4d94-816e-64118e4ee268 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:34.750937 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa8f56-daa7-4eac-a717-b80437825aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:34.751561 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa8f56-daa7-4eac-a717-b80437825aaf None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:34.751839 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa8f56-daa7-4eac-a717-b80437825aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:34.752110 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa8f56-daa7-4eac-a717-b80437825aaf None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:34.752801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa8f56-daa7-4eac-a717-b80437825aaf None admin] RBAC: Adding query filter params (name=image) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:34.753100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa8f56-daa7-4eac-a717-b80437825aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:34.754732 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa8f56-daa7-4eac-a717-b80437825aaf None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:34.760508 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 374/728] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:34.761826 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b582a4-25cd-44a7-9502-4ca8faf53a41 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:34.762123 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b582a4-25cd-44a7-9502-4ca8faf53a41 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:34.762423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b582a4-25cd-44a7-9502-4ca8faf53a41 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:34.764019 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 375/729] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:34.768107 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b582a4-25cd-44a7-9502-4ca8faf53a41 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:34.800763 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f340e1-95f5-434b-bb2a-4b9dfcea41b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:34.801505 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f340e1-95f5-434b-bb2a-4b9dfcea41b2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:34.801826 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f340e1-95f5-434b-bb2a-4b9dfcea41b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:34.802105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f340e1-95f5-434b-bb2a-4b9dfcea41b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:34.802914 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f340e1-95f5-434b-bb2a-4b9dfcea41b2 None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=61b8da64c241441d986c7c11f3fe2e9d) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:34.803312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f340e1-95f5-434b-bb2a-4b9dfcea41b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:34.804787 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f340e1-95f5-434b-bb2a-4b9dfcea41b2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:34.812434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 355/730] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:53:34 2022] GET /identity/v3/role_assignments?user.id=61b8da64c241441d986c7c11f3fe2e9d&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:34.813941 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93188-2001-433c-b35a-82aa7321f125 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:34.814279 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93188-2001-433c-b35a-82aa7321f125 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:34.814561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b93188-2001-433c-b35a-82aa7321f125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:34.842657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-21b93188-2001-433c-b35a-82aa7321f125 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:34.845373 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-21b93188-2001-433c-b35a-82aa7321f125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:34.923426 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:34.937601 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:34.946907 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 356/731] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:34.959907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b582a4-25cd-44a7-9502-4ca8faf53a41 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:35.007742 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:35.008932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:35.009495 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:35.009984 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:35.010919 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] RBAC: Adding query filter params (type=image) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:35.011628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:35.013566 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:35.021482 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 376/732] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:35.027450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b93188-2001-433c-b35a-82aa7321f125 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:35.162770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b93188-2001-433c-b35a-82aa7321f125 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:35.206921 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585de3f-3d9a-4bbd-8764-6a59cacc057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:35.208109 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585de3f-3d9a-4bbd-8764-6a59cacc057e None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:35.208725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585de3f-3d9a-4bbd-8764-6a59cacc057e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:35.209228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585de3f-3d9a-4bbd-8764-6a59cacc057e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:35.210146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585de3f-3d9a-4bbd-8764-6a59cacc057e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:35.211734 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585de3f-3d9a-4bbd-8764-6a59cacc057e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:35.240945 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 357/733] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:35.448272 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:35.597589 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130df0c4-daff-4fbd-b424-ad59d27878d6 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:35.649273 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:35.650285 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:35.650733 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:35.651197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] PATH_INFO: `/v3/services/network` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:35.651996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:35.654005 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:35.665134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:35.666528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:53:35.667658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:35.670786 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 377/734] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:35 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:35.676609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585de3f-3d9a-4bbd-8764-6a59cacc057e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:35.737295 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:35.823067 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585de3f-3d9a-4bbd-8764-6a59cacc057e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:35.865404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8073b4d-03de-4501-b1b5-ca95814bcc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:35.866068 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073b4d-03de-4501-b1b5-ca95814bcc81 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:35.866358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073b4d-03de-4501-b1b5-ca95814bcc81 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:35.866636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8073b4d-03de-4501-b1b5-ca95814bcc81 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:35.867275 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8073b4d-03de-4501-b1b5-ca95814bcc81 None admin] RBAC: Adding query filter params (name=network) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:35.867582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8073b4d-03de-4501-b1b5-ca95814bcc81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:35.868997 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8073b4d-03de-4501-b1b5-ca95814bcc81 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:35.874551 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 358/735] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:35.880159 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:35.897177 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:35.972741 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce288-db17-46da-8835-94895664c8ca None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:35.973084 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce288-db17-46da-8835-94895664c8ca None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:35.973314 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ce288-db17-46da-8835-94895664c8ca None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:35.974895 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 359/736] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:35.979954 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f4abd-de06-42c5-85e9-f841ed64c563 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:35.980243 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f4abd-de06-42c5-85e9-f841ed64c563 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:35.980908 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f4abd-de06-42c5-85e9-f841ed64c563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:35.993781 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a3e4-ff4f-4f5c-957a-c9e51390444c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:35.998801 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-832f4abd-de06-42c5-85e9-f841ed64c563 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:36.000005 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-832f4abd-de06-42c5-85e9-f841ed64c563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:36.030314 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:36.031324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:36.031812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:36.032286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:36.033128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] RBAC: Adding query filter params (type=network) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:36.033619 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:36.035193 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:36.041083 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 378/737] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:36.048771 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:36.084808 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 360/738] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:35 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:53:36.147611 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:36.177204 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e6138-1308-441a-84c8-e5ecd2dee18b None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:36.217324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b99c02-c54b-4f81-83eb-c7196f9e8275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:36.218433 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b99c02-c54b-4f81-83eb-c7196f9e8275 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:36.218896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b99c02-c54b-4f81-83eb-c7196f9e8275 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:36.219370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b99c02-c54b-4f81-83eb-c7196f9e8275 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:36.220218 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b99c02-c54b-4f81-83eb-c7196f9e8275 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:36.221764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b99c02-c54b-4f81-83eb-c7196f9e8275 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:36.250058 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 379/739] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:36 2022] POST /identity/v3/endpoints => generated 337 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:53:36.453345 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f4abd-de06-42c5-85e9-f841ed64c563 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:36.491662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:36.565471 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f4abd-de06-42c5-85e9-f841ed64c563 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:36.609122 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:36.610061 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:36.610576 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:36.611040 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:36.611798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:36.613361 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:36.622328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:36.623403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:53:36.624357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:36.625634 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 361/740] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 24 09:53:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:36.631486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b99c02-c54b-4f81-83eb-c7196f9e8275 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:36.736447 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b99c02-c54b-4f81-83eb-c7196f9e8275 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:36.766512 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:36.773421 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:36.774163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:36.774443 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:36.774829 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:36.775733 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:36.776008 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:36.777715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:36.791904 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 380/741] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 09:53:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:36.793243 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:36.898691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:36.911502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92bee4-c22f-4e2b-96f7-b8b8ef858fbf None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:36.946685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c4a28-f8ed-4bd3-a400-2d2e71e251da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:36.947621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c4a28-f8ed-4bd3-a400-2d2e71e251da None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:36.948101 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c4a28-f8ed-4bd3-a400-2d2e71e251da None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:36.948568 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c4a28-f8ed-4bd3-a400-2d2e71e251da None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:36.949395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c4a28-f8ed-4bd3-a400-2d2e71e251da None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:36.949875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c4a28-f8ed-4bd3-a400-2d2e71e251da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:36.951459 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c4a28-f8ed-4bd3-a400-2d2e71e251da None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:36.957673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 362/742] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 24 09:53:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:36.963272 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:37.195861 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2daf24-3fda-4f38-88e4-c7868727e580 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:37.234530 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570084f-f1b4-4b3c-b717-551e3420c6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:37.235154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570084f-f1b4-4b3c-b717-551e3420c6a2 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:37.235497 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570084f-f1b4-4b3c-b717-551e3420c6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:37.235774 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570084f-f1b4-4b3c-b717-551e3420c6a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:37.236452 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570084f-f1b4-4b3c-b717-551e3420c6a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:37.237882 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570084f-f1b4-4b3c-b717-551e3420c6a2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:37.263473 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 381/743] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:53:37.263673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecac050-bb94-4435-add8-ffcfba7f6944 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:37.263673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecac050-bb94-4435-add8-ffcfba7f6944 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:37.263673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecac050-bb94-4435-add8-ffcfba7f6944 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:37.263673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 363/744] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:37.269237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1fa14-adc5-4f55-8786-e886b3b284e0 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:37.269533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1fa14-adc5-4f55-8786-e886b3b284e0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:37.269794 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1fa14-adc5-4f55-8786-e886b3b284e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:37.289578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-c3b1fa14-adc5-4f55-8786-e886b3b284e0 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:37.290846 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c3b1fa14-adc5-4f55-8786-e886b3b284e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:37.348814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:37.384706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 382/745] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:37 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:37.645984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b776-b354-4d4f-b789-81d81e296682 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:37.646569 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b776-b354-4d4f-b789-81d81e296682 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:37.646569 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b776-b354-4d4f-b789-81d81e296682 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:37.647852 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 364/746] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:37.653718 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6998eb-3f04-4cdf-ad1f-874f8725ea90 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:37.654162 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6998eb-3f04-4cdf-ad1f-874f8725ea90 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:37.654254 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6998eb-3f04-4cdf-ad1f-874f8725ea90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:37.673666 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ca6998eb-3f04-4cdf-ad1f-874f8725ea90 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:37.674869 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ca6998eb-3f04-4cdf-ad1f-874f8725ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:37.731854 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1b776-b354-4d4f-b789-81d81e296682 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:37.751293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 383/747] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:37 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:37.840949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1b776-b354-4d4f-b789-81d81e296682 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:37.882083 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:37.882727 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:37.883010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:37.883291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:37.883877 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:37.885283 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:37.895436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:37.896468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:37.897531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 365/748] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 24 09:53:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:37.904743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6998eb-3f04-4cdf-ad1f-874f8725ea90 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:38.009167 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6998eb-3f04-4cdf-ad1f-874f8725ea90 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:38.018930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:38.046056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:38.046752 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:38.047101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:38.047444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:38.048169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:38.048536 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:38.049992 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:38.054818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 384/749] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 09:53:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:38.060446 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:38.083689 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:38.087824 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:38.173647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de2de3-8077-4d79-8c19-9cefbf0abb71 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:38.191505 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f34de8-b54d-4746-89dd-7712464e25e3 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:38.219309 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:38.219814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:38.220115 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:38.220353 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:38.221036 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:38.221341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:38.223003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:38.228936 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 366/750] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 09:53:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:53:38.234733 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251ef25-6ae3-4ca5-9e51-ed931f09fe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:38.235551 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ef25-6ae3-4ca5-9e51-ed931f09fe8c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:38.235839 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ef25-6ae3-4ca5-9e51-ed931f09fe8c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:38.236144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251ef25-6ae3-4ca5-9e51-ed931f09fe8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:38.286429 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:38.320126 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251ef25-6ae3-4ca5-9e51-ed931f09fe8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:38.321651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251ef25-6ae3-4ca5-9e51-ed931f09fe8c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:38.435438 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 385/751] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:53:38 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:53:38.441950 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:38.534434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:38.548232 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea749d-a729-4792-beed-f6f6dfd72ba4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:38.589208 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acd9a9-6b0d-4fa4-9ecc-945c37d458af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:38.590128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd9a9-6b0d-4fa4-9ecc-945c37d458af None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:38.590597 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd9a9-6b0d-4fa4-9ecc-945c37d458af None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:38.590885 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd9a9-6b0d-4fa4-9ecc-945c37d458af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:38.605325 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acd9a9-6b0d-4fa4-9ecc-945c37d458af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:38.607360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acd9a9-6b0d-4fa4-9ecc-945c37d458af None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-18acd9a9-6b0d-4fa4-9ecc-945c37d458af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:53:38.625184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:38.626239 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:53:38.627160 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:53:38.627160 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:53:38.627160 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:38.628745 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 367/752] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:38.632219 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251ef25-6ae3-4ca5-9e51-ed931f09fe8c None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:38.707688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:38.740269 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251ef25-6ae3-4ca5-9e51-ed931f09fe8c None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:38.774924 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119ae7b-4f4a-4fd6-92da-5d1d641cf890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:38.775529 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ae7b-4f4a-4fd6-92da-5d1d641cf890 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:38.775814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ae7b-4f4a-4fd6-92da-5d1d641cf890 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:38.776083 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ae7b-4f4a-4fd6-92da-5d1d641cf890 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:38.776746 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ae7b-4f4a-4fd6-92da-5d1d641cf890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:38.777046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ae7b-4f4a-4fd6-92da-5d1d641cf890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:38.778405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ae7b-4f4a-4fd6-92da-5d1d641cf890 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:38.790176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 386/753] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:39.527076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b46aa-b998-4145-b3eb-46f717c37cbf None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.527613 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b46aa-b998-4145-b3eb-46f717c37cbf None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.527613 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b46aa-b998-4145-b3eb-46f717c37cbf None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.528984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 368/754] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:39.534929 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624aa12-bb6c-46ed-b3a0-9e39be34b7ea None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.535218 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624aa12-bb6c-46ed-b3a0-9e39be34b7ea None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.535499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624aa12-bb6c-46ed-b3a0-9e39be34b7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.553184 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e624aa12-bb6c-46ed-b3a0-9e39be34b7ea None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:39.554481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e624aa12-bb6c-46ed-b3a0-9e39be34b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:39.630125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 387/755] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:39 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:39.955285 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b46aa-b998-4145-b3eb-46f717c37cbf None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.057427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b46aa-b998-4145-b3eb-46f717c37cbf None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.091419 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.092075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.092453 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.092759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.093596 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.094955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:40.103662 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:40.104767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:40.105631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:40.109022 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 369/756] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:40.110713 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624aa12-bb6c-46ed-b3a0-9e39be34b7ea None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.171125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:40.209369 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624aa12-bb6c-46ed-b3a0-9e39be34b7ea None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.242491 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c6e1f-c521-41b1-8197-708019213a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.243088 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c6e1f-c521-41b1-8197-708019213a6f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.243365 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c6e1f-c521-41b1-8197-708019213a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.243634 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c6e1f-c521-41b1-8197-708019213a6f None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.244252 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c6e1f-c521-41b1-8197-708019213a6f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:40.244549 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c6e1f-c521-41b1-8197-708019213a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.245949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c6e1f-c521-41b1-8197-708019213a6f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.250856 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 388/757] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:40.256513 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.260826 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:40.360036 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1777a-6531-4b7d-aeef-b522fc03d688 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.393847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c621d-6fcc-44e8-a41c-cfc86d2e3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.394445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c621d-6fcc-44e8-a41c-cfc86d2e3932 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.394725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c621d-6fcc-44e8-a41c-cfc86d2e3932 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.394994 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c621d-6fcc-44e8-a41c-cfc86d2e3932 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.395617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c621d-6fcc-44e8-a41c-cfc86d2e3932 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:40.395913 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c621d-6fcc-44e8-a41c-cfc86d2e3932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.397306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c621d-6fcc-44e8-a41c-cfc86d2e3932 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.401770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 370/758] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:40.460769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd18cde-ab4f-4db0-b491-77ec06eff87b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.460968 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd18cde-ab4f-4db0-b491-77ec06eff87b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.461213 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd18cde-ab4f-4db0-b491-77ec06eff87b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.462861 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 389/759] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:40.469284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e719f2d-3b6b-49f8-a3b2-3f2150935433 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.469568 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e719f2d-3b6b-49f8-a3b2-3f2150935433 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.469843 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e719f2d-3b6b-49f8-a3b2-3f2150935433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.490241 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8e719f2d-3b6b-49f8-a3b2-3f2150935433 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:40.491516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8e719f2d-3b6b-49f8-a3b2-3f2150935433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:40.564417 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:40.574284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 371/760] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:40 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:40.902144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd18cde-ab4f-4db0-b491-77ec06eff87b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:41.002739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd18cde-ab4f-4db0-b491-77ec06eff87b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:41.027825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:41.037012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadbd5-9ae4-41e4-b391-9ff6e2d4beb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:41.037612 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadbd5-9ae4-41e4-b391-9ff6e2d4beb2 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:41.037893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadbd5-9ae4-41e4-b391-9ff6e2d4beb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:41.038163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadbd5-9ae4-41e4-b391-9ff6e2d4beb2 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:41.038798 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efadbd5-9ae4-41e4-b391-9ff6e2d4beb2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:41.040154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efadbd5-9ae4-41e4-b391-9ff6e2d4beb2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:41.054574 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 390/761] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:53:40 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:42.616611 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da00c2-cf52-4e0e-ab19-299f5f917f69 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:42.617168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da00c2-cf52-4e0e-ab19-299f5f917f69 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:42.617168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da00c2-cf52-4e0e-ab19-299f5f917f69 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:42.618661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 372/762] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:42.623946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ff4b-3b8d-42b7-a58c-fd78ce162873 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:42.624344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ff4b-3b8d-42b7-a58c-fd78ce162873 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:42.624563 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ff4b-3b8d-42b7-a58c-fd78ce162873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:42.642716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-c1d3ff4b-3b8d-42b7-a58c-fd78ce162873 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:42.643879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c1d3ff4b-3b8d-42b7-a58c-fd78ce162873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:42.716294 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 391/763] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:42 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:43.043977 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da00c2-cf52-4e0e-ab19-299f5f917f69 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:43.151047 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da00c2-cf52-4e0e-ab19-299f5f917f69 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:43.186494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfc555-0ae4-49c5-8bba-92c9e5c755a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:43.187018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfc555-0ae4-49c5-8bba-92c9e5c755a5 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:43.187304 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfc555-0ae4-49c5-8bba-92c9e5c755a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:43.187573 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfc555-0ae4-49c5-8bba-92c9e5c755a5 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:43.188211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfc555-0ae4-49c5-8bba-92c9e5c755a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:43.189617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bfc555-0ae4-49c5-8bba-92c9e5c755a5 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:43.204753 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 373/764] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:53:43 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:43.260633 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a4bd-e48d-4a49-a8dd-c7b153caf777 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:43.261077 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a4bd-e48d-4a49-a8dd-c7b153caf777 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:43.261423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a4bd-e48d-4a49-a8dd-c7b153caf777 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:43.262884 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 392/765] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:43.269029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fe7b7-f873-4169-9baf-83affd6735fb None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:43.269323 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fe7b7-f873-4169-9baf-83affd6735fb None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:43.269605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fe7b7-f873-4169-9baf-83affd6735fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:43.288868 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ff4fe7b7-f873-4169-9baf-83affd6735fb None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:43.290116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ff4fe7b7-f873-4169-9baf-83affd6735fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:43.349372 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:43.371179 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 374/766] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:43 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:43.701717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a4bd-e48d-4a49-a8dd-c7b153caf777 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:43.809993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a4bd-e48d-4a49-a8dd-c7b153caf777 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:43.823200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:43.846039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:43.846667 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:43.846939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:43.847205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:43.847773 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:43.849162 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:43.858745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:43.859714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:43.860652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 393/767] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 24 09:53:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:43.865836 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fe7b7-f873-4169-9baf-83affd6735fb None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:43.965789 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fe7b7-f873-4169-9baf-83affd6735fb None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:43.999705 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:44.000302 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:44.000586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:44.000887 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:44.001512 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:44.001815 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:44.003175 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:44.007701 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 375/768] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 09:53:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:44.013447 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:44.113833 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630603d-2bcc-42a9-8293-f237bf3f4400 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:44.147670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:44.148279 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:44.148556 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:44.148859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:44.149481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:44.149780 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:44.151249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:44.156755 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 394/769] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 09:53:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:44.162712 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:44.210251 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:44.259884 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e9dd4-6267-46fb-aefd-90fe66a08a1c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:44.293947 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada3804-ae69-4922-95b9-8f95896ec4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:44.294537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada3804-ae69-4922-95b9-8f95896ec4b8 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:44.294812 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada3804-ae69-4922-95b9-8f95896ec4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:44.295112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada3804-ae69-4922-95b9-8f95896ec4b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:44.295798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada3804-ae69-4922-95b9-8f95896ec4b8 None admin] RBAC: Adding query filter params (interface=public, service_id=1851b7ce9fe242b380e2deea5a7f5016, region_id=RegionOne) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:44.296100 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada3804-ae69-4922-95b9-8f95896ec4b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:44.297481 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada3804-ae69-4922-95b9-8f95896ec4b8 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:44.302565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 376/770] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 09:53:44 2022] GET /identity/v3/endpoints?service_id=1851b7ce9fe242b380e2deea5a7f5016&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:44.307943 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:44.350990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:44.408414 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5a60-15f3-4035-9fbf-f816c1834b48 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:44.441013 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b8155-81f9-457a-b32b-d82ece94c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:44.441617 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8155-81f9-457a-b32b-d82ece94c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:44.441895 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8155-81f9-457a-b32b-d82ece94c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:44.442167 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8155-81f9-457a-b32b-d82ece94c6f6 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:44.442763 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b8155-81f9-457a-b32b-d82ece94c6f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:44.444133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b8155-81f9-457a-b32b-d82ece94c6f6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:44.449913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 395/771] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 09:53:44 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:45.462237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814c725-a8eb-427a-8daa-34ed3cb46c19 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:45.462781 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814c725-a8eb-427a-8daa-34ed3cb46c19 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:45.462781 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814c725-a8eb-427a-8daa-34ed3cb46c19 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:45.464126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 377/772] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:45.470993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b2d16-1e93-4650-8f67-118ea5e73778 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:45.471527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b2d16-1e93-4650-8f67-118ea5e73778 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:45.471527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b2d16-1e93-4650-8f67-118ea5e73778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:45.490407 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-c40b2d16-1e93-4650-8f67-118ea5e73778 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:45.491629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c40b2d16-1e93-4650-8f67-118ea5e73778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:45.561877 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 396/773] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:45 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:45.887630 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814c725-a8eb-427a-8daa-34ed3cb46c19 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:45.990293 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814c725-a8eb-427a-8daa-34ed3cb46c19 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.003922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:46.026176 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.026808 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.027087 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.027360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.027940 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.029331 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:46.038229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:46.039318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:46.040199 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 378/774] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:46.045322 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b2d16-1e93-4650-8f67-118ea5e73778 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:46.079095 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:46.145572 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b2d16-1e93-4650-8f67-118ea5e73778 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.179787 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.180412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.180719 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.180993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.181638 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:46.181935 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.183338 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.189231 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 397/775] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:46.195084 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:46.295747 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75931ce-4364-42fb-9937-62868a870369 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.329473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.330080 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.330364 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.330642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.331278 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:46.331582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.332979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.337894 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 379/776] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:46.344344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:46.440361 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:46.444793 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e7849-41b4-402b-8ff7-1f4d5987b398 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.480953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a18a-a4a2-4ad9-92a9-a0114c3228b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.481672 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a18a-a4a2-4ad9-92a9-a0114c3228b7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.481863 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a18a-a4a2-4ad9-92a9-a0114c3228b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.482141 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a18a-a4a2-4ad9-92a9-a0114c3228b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.483359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a18a-a4a2-4ad9-92a9-a0114c3228b7 None admin] RBAC: Adding query filter params (interface=public, service_id=35b63770f1ed453ebbfa9167c646343b, region_id=RegionOne) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:46.483670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a18a-a4a2-4ad9-92a9-a0114c3228b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.485152 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a18a-a4a2-4ad9-92a9-a0114c3228b7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.491107 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 398/777] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 09:53:46 2022] GET /identity/v3/endpoints?service_id=35b63770f1ed453ebbfa9167c646343b&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:46.497144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:46.540617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:46.598802 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26329c-b803-4192-904c-79f770f39484 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.631892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de701de-bc2b-4cf0-ad60-ef5b197fc8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.632495 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de701de-bc2b-4cf0-ad60-ef5b197fc8c1 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.632816 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de701de-bc2b-4cf0-ad60-ef5b197fc8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.633093 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de701de-bc2b-4cf0-ad60-ef5b197fc8c1 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.633689 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de701de-bc2b-4cf0-ad60-ef5b197fc8c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.635050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de701de-bc2b-4cf0-ad60-ef5b197fc8c1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.640827 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 380/778] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 09:53:46 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:53:46.642851 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246f0e-b60f-4441-970e-aa8f82773ecf None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.643135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246f0e-b60f-4441-970e-aa8f82773ecf None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.643406 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246f0e-b60f-4441-970e-aa8f82773ecf None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.644748 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 399/779] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:46.650485 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167e8d-41d1-49ba-9ea9-bf2271e495c4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.650771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167e8d-41d1-49ba-9ea9-bf2271e495c4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.651045 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167e8d-41d1-49ba-9ea9-bf2271e495c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.671263 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-0d167e8d-41d1-49ba-9ea9-bf2271e495c4 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:46.672476 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-0d167e8d-41d1-49ba-9ea9-bf2271e495c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:46.744027 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 381/780] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:46 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:47.068406 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246f0e-b60f-4441-970e-aa8f82773ecf None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.174281 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246f0e-b60f-4441-970e-aa8f82773ecf None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.207560 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.208187 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.208465 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.208769 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.209347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.210704 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:47.220356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:47.221519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:47.222525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 400/781] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 24 09:53:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:47.227351 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d167e8d-41d1-49ba-9ea9-bf2271e495c4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.259796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:47.328116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d167e8d-41d1-49ba-9ea9-bf2271e495c4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.362332 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.362935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.363214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.363487 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.364112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:47.364413 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.365805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.370665 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 382/782] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 09:53:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:47.376595 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.404643 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:47.474033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1bd7f-eccd-49ab-9d77-0a09ef9dae3e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.506399 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfde90-9ca9-45bc-b67f-230782a0cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.506982 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfde90-9ca9-45bc-b67f-230782a0cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.507248 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfde90-9ca9-45bc-b67f-230782a0cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.507517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfde90-9ca9-45bc-b67f-230782a0cdc7 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.508128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfde90-9ca9-45bc-b67f-230782a0cdc7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:47.508421 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfde90-9ca9-45bc-b67f-230782a0cdc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.510991 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfde90-9ca9-45bc-b67f-230782a0cdc7 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.516242 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 401/783] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 24 09:53:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:47.522032 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.619448 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:47.623708 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd31e5-93db-4f04-b960-25cf2af57413 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.658955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f11ec-5cba-47d4-a172-7c8772b2a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.659561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f11ec-5cba-47d4-a172-7c8772b2a5b1 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.659844 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f11ec-5cba-47d4-a172-7c8772b2a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.660118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f11ec-5cba-47d4-a172-7c8772b2a5b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.660819 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f11ec-5cba-47d4-a172-7c8772b2a5b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.662186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f11ec-5cba-47d4-a172-7c8772b2a5b1 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.682941 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 383/784] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:48.862166 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e9a5-d4c1-461f-926f-22e5a88a0871 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.862700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e9a5-d4c1-461f-926f-22e5a88a0871 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.862700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e9a5-d4c1-461f-926f-22e5a88a0871 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.864014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 402/785] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:48.869259 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f06a1-930f-437c-a3e6-33138b97dda7 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.869675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f06a1-930f-437c-a3e6-33138b97dda7 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.869792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f06a1-930f-437c-a3e6-33138b97dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.887857 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8b3f06a1-930f-437c-a3e6-33138b97dda7 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:48.889694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8b3f06a1-930f-437c-a3e6-33138b97dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:48.961967 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 384/786] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:48 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:49.301188 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74e9a5-d4c1-461f-926f-22e5a88a0871 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:49.392826 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:49.403936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74e9a5-d4c1-461f-926f-22e5a88a0871 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:49.437714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:49.438334 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.438612 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.438879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.439448 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:49.440841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:49.449278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:49.450444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:49.451360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 403/787] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:49.456357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f06a1-930f-437c-a3e6-33138b97dda7 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:49.539099 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:49.559934 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f06a1-930f-437c-a3e6-33138b97dda7 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:49.594625 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:49.595233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.595515 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.595793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.596418 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:49.596752 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:49.598127 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:49.602795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 385/788] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:49.608960 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:49.710281 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6aaeb-2a76-4550-a52b-5f1141a66676 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:49.744838 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf99974-e64f-4758-9329-ea05778b20ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:49.745425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf99974-e64f-4758-9329-ea05778b20ed None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.745705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf99974-e64f-4758-9329-ea05778b20ed None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.745979 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf99974-e64f-4758-9329-ea05778b20ed None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.746603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf99974-e64f-4758-9329-ea05778b20ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:49.746901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf99974-e64f-4758-9329-ea05778b20ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:49.748297 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf99974-e64f-4758-9329-ea05778b20ed None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:49.753138 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 404/789] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 24 09:53:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:49.759085 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:49.863176 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3649-27b4-4fd7-9abf-c03d2dbf4d8e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:49.897250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086a573-4306-4a16-8432-802b080346ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:49.897888 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a573-4306-4a16-8432-802b080346ec None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.898112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a573-4306-4a16-8432-802b080346ec None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.898383 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086a573-4306-4a16-8432-802b080346ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.899028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086a573-4306-4a16-8432-802b080346ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:49.900374 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086a573-4306-4a16-8432-802b080346ec None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:49.916471 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:49.924919 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 386/790] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:49.942283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7152-eaff-41df-99d3-b12d849ec36c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.942914 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7152-eaff-41df-99d3-b12d849ec36c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.942914 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7152-eaff-41df-99d3-b12d849ec36c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.944420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 405/791] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:49.950725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bd66-c68d-4181-b514-490b1086dac2 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.951528 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bd66-c68d-4181-b514-490b1086dac2 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.951834 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bd66-c68d-4181-b514-490b1086dac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.971754 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-1d00bd66-c68d-4181-b514-490b1086dac2 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:49.973019 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-1d00bd66-c68d-4181-b514-490b1086dac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:50.050348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 387/792] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:49 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:50.383857 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7152-eaff-41df-99d3-b12d849ec36c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.403567 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:50.486938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7152-eaff-41df-99d3-b12d849ec36c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.524132 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.524792 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.525076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.525347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] PATH_INFO: `/v3/services/compute` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.525927 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.527302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:50.536021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:50.537103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:50.537962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 406/793] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:50.543220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00bd66-c68d-4181-b514-490b1086dac2 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.643375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00bd66-c68d-4181-b514-490b1086dac2 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.669366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:50.679274 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cb382-f5a6-46cc-9c16-f9996a673f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.679882 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb382-f5a6-46cc-9c16-f9996a673f7b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.680163 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb382-f5a6-46cc-9c16-f9996a673f7b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.680455 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb382-f5a6-46cc-9c16-f9996a673f7b None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.681112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cb382-f5a6-46cc-9c16-f9996a673f7b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:50.681413 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cb382-f5a6-46cc-9c16-f9996a673f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.682787 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cb382-f5a6-46cc-9c16-f9996a673f7b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.688074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 388/794] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:50.693933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.775936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:50.795304 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45251a20-2c82-45e3-800f-673526d1bdde None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.830586 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436cc54-6fb0-4adc-88d0-00eee898ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.831195 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cc54-6fb0-4adc-88d0-00eee898ee69 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.831469 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cc54-6fb0-4adc-88d0-00eee898ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.831736 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cc54-6fb0-4adc-88d0-00eee898ee69 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.832356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436cc54-6fb0-4adc-88d0-00eee898ee69 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:50.832652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436cc54-6fb0-4adc-88d0-00eee898ee69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.834033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436cc54-6fb0-4adc-88d0-00eee898ee69 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.838504 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 407/795] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:52.211304 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0e190-b330-492a-99bc-6c1349e301da None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:52.211810 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0e190-b330-492a-99bc-6c1349e301da None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:52.211810 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0e190-b330-492a-99bc-6c1349e301da None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:52.213127 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 389/796] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:52.218909 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cbbb-0621-4839-ae22-c9ffb6453558 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:52.219318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cbbb-0621-4839-ae22-c9ffb6453558 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:52.219450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3cbbb-0621-4839-ae22-c9ffb6453558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:52.237543 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-2ec3cbbb-0621-4839-ae22-c9ffb6453558 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:52.238717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-2ec3cbbb-0621-4839-ae22-c9ffb6453558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:52.302896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 408/797] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:52 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:53:52.634879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0e190-b330-492a-99bc-6c1349e301da None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:52.738911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0e190-b330-492a-99bc-6c1349e301da None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:52.771770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:52.772366 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:52.772641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:52.772931 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:52.773564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:52.774977 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:52.777579 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING keystone.server.flask.common [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 09:53:52.795441 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.sql.core [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:53:52.795441 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 09:53:52.795441 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [parameters: {'id': '0e21871db4e64a528f94937d601dd09c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 09:53:52.795441 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88305) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e21871db4e64a528f94937d601dd09c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e21871db4e64a528f94937d601dd09c. Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:53:52.811642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result.read() Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 09:53:52.812643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application yield resource Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise self.value Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application session.commit() Aug 24 09:53:52.813917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:53:52.815048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:53:52.816196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result.read() Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:53:52.817242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [parameters: {'id': '0e21871db4e64a528f94937d601dd09c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:52.818773 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:52.819796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0e21871db4e64a528f94937d601dd09c. Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:52.821096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 390/798] 10.222.0.70 () {60 vars in 1140 bytes} [Wed Aug 24 09:53:52 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:52.824273 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3cbbb-0621-4839-ae22-c9ffb6453558 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:52.911167 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:52.936922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3cbbb-0621-4839-ae22-c9ffb6453558 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:52.973609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d986da-913e-4f31-a0a8-8fbb9ef3b85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:52.974244 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d986da-913e-4f31-a0a8-8fbb9ef3b85c None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:52.974522 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d986da-913e-4f31-a0a8-8fbb9ef3b85c None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:52.974792 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d986da-913e-4f31-a0a8-8fbb9ef3b85c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:52.981871 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d986da-913e-4f31-a0a8-8fbb9ef3b85c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:52.983315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d986da-913e-4f31-a0a8-8fbb9ef3b85c None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-30d986da-913e-4f31-a0a8-8fbb9ef3b85c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:53:52.994377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:52.995373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:52.996426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 409/799] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:53.001513 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:53.049398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:53.057238 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe10cc-fcc8-4852-948f-1e213b9dc694 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:53.057486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe10cc-fcc8-4852-948f-1e213b9dc694 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:53.057757 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe10cc-fcc8-4852-948f-1e213b9dc694 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:53.059075 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 410/800] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:53.064214 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361722fb-069b-4f9d-8c46-87d4b162a29f None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:53.064496 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361722fb-069b-4f9d-8c46-87d4b162a29f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:53.064803 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361722fb-069b-4f9d-8c46-87d4b162a29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:53.083178 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-361722fb-069b-4f9d-8c46-87d4b162a29f None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:53.084378 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-361722fb-069b-4f9d-8c46-87d4b162a29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:53.105236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eebeac-aa11-4d81-9016-99d85ff410cf None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:53.140184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05c91-b8dc-4a20-b261-0ef8f4af12ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:53.140833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05c91-b8dc-4a20-b261-0ef8f4af12ca None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:53.141119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05c91-b8dc-4a20-b261-0ef8f4af12ca None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:53.141389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05c91-b8dc-4a20-b261-0ef8f4af12ca None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:53.142047 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05c91-b8dc-4a20-b261-0ef8f4af12ca None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:53.142350 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05c91-b8dc-4a20-b261-0ef8f4af12ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:53.143982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05c91-b8dc-4a20-b261-0ef8f4af12ca None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:53.155432 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 411/801] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:53 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:53:53.176770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 391/802] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:53.484140 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361722fb-069b-4f9d-8c46-87d4b162a29f None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:53.548533 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:53.586135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361722fb-069b-4f9d-8c46-87d4b162a29f None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:53.622100 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910660f3-ed42-494a-8ee5-52feef21f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:53.623350 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910660f3-ed42-494a-8ee5-52feef21f76d None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:53.623725 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910660f3-ed42-494a-8ee5-52feef21f76d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:53.623959 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910660f3-ed42-494a-8ee5-52feef21f76d None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:53.624773 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910660f3-ed42-494a-8ee5-52feef21f76d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:53.626410 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910660f3-ed42-494a-8ee5-52feef21f76d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:53.642825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 412/803] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:53:53 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:55.417593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35a73-2ef2-4b1a-837a-3032c7c168f5 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:55.418126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35a73-2ef2-4b1a-837a-3032c7c168f5 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:55.418126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c35a73-2ef2-4b1a-837a-3032c7c168f5 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:55.420114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 392/804] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:55.425450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb06e-4c06-457a-a863-31755aaca31c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:55.425901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb06e-4c06-457a-a863-31755aaca31c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:55.425993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95eb06e-4c06-457a-a863-31755aaca31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:55.444519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f95eb06e-4c06-457a-a863-31755aaca31c None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:55.445773 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f95eb06e-4c06-457a-a863-31755aaca31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:55.518011 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 413/805] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:55 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:55.835764 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b557a-2f19-4eee-8dbf-2266f6bdf43f None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:55.836058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b557a-2f19-4eee-8dbf-2266f6bdf43f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:55.836337 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b557a-2f19-4eee-8dbf-2266f6bdf43f None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:55.837741 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 393/806] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:55.843907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d6f8-d711-4709-b860-455b1b17fd63 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:55.844687 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d6f8-d711-4709-b860-455b1b17fd63 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:55.845038 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d6f8-d711-4709-b860-455b1b17fd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:55.850120 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b557a-2f19-4eee-8dbf-2266f6bdf43f None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:55.864709 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-3eb5d6f8-d711-4709-b860-455b1b17fd63 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:55.865883 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3eb5d6f8-d711-4709-b860-455b1b17fd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:55.918025 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:55.940099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 414/807] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:55 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:55.964843 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b557a-2f19-4eee-8dbf-2266f6bdf43f None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:55.973709 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:56.002677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:56.003292 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.003574 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.003846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.004502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:56.005988 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:56.021628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.sql.core [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:53:56.021628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 09:53:56.021628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [parameters: {'user_id': '1a52fb99d34a4badb9a09ec4a029bb95', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 09:53:56.021628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88305) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result.read() Aug 24 09:53:56.028818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:53:56.030469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application yield resource Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise self.value Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application session.commit() Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:53:56.031473 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:53:56.032395 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:53:56.033377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application result.read() Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:53:56.034242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [parameters: {'user_id': '1a52fb99d34a4badb9a09ec4a029bb95', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:56.035114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 09:53:56.035938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 09:53:56.038482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 09:53:56.038482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 09:53:56.038482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:53:56.038482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:53:56.038482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 09:53:56.038482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:56.038482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 394/808] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 24 09:53:55 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:56.039319 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5d6f8-d711-4709-b860-455b1b17fd63 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:56.143705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5d6f8-d711-4709-b860-455b1b17fd63 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:56.179278 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:56.179917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.180199 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.180476 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.187859 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:56.189374 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:53:56.200701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:56.202302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:56.203808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 415/809] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:53:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:56.208333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:56.266289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:56.309990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:56.310672 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b9621-a18f-4b2c-9ed9-2f6be3bdd3f2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:56.345630 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:56.346228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.346509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.346777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.347470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:56.347771 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:56.349426 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:56.367010 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844da38-4091-4f42-b8af-558aabe6cd18 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:56.386587 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 395/810] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 24 09:53:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:56.401359 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:56.401935 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.402215 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.402484 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.403076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:56.404568 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:56.414112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:56.415423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:53:56.416716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 416/811] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:53:56.421701 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:56.452507 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:56.532400 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cb390-9ded-4f9c-9f18-a01979f23db4 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:56.568533 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:56.569178 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.569457 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.569810 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.570358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] RBAC: Adding query filter params (name=compute) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:56.570661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:56.572030 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:56.577792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 396/812] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:56.583696 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:56.689645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ec2a-f48a-40da-9f0f-c53764b25457 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:56.696547 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:56.723183 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:56.723779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.724053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.724324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.724977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:56.725275 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:56.726641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:56.731336 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 417/813] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:56.737955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:56.830140 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:56.840169 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c69d1e-0d3d-4896-911d-0cca3afc49fa None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:56.874262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad21c5-af34-4100-83a2-995de32fbc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:56.874860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad21c5-af34-4100-83a2-995de32fbc3f None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.875141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad21c5-af34-4100-83a2-995de32fbc3f None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.875414 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad21c5-af34-4100-83a2-995de32fbc3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.876106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad21c5-af34-4100-83a2-995de32fbc3f None admin] RBAC: Adding query filter params (interface=public, service_id=eee321ffb2114009ab9eee87a24dbf43, region_id=RegionOne) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:56.876413 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad21c5-af34-4100-83a2-995de32fbc3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:56.877804 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad21c5-af34-4100-83a2-995de32fbc3f None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:56.882765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 397/814] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 09:53:56 2022] GET /identity/v3/endpoints?service_id=eee321ffb2114009ab9eee87a24dbf43&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:56.888388 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:56.986343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581b89-d1d2-4231-9220-41c845f2354f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:57.019335 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6c7c7-b3f7-4662-94a1-a4a2dd6f304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:57.019934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c7c7-b3f7-4662-94a1-a4a2dd6f304f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:57.020215 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c7c7-b3f7-4662-94a1-a4a2dd6f304f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:57.020488 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c7c7-b3f7-4662-94a1-a4a2dd6f304f None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:57.021114 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6c7c7-b3f7-4662-94a1-a4a2dd6f304f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:57.022487 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6c7c7-b3f7-4662-94a1-a4a2dd6f304f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:57.028465 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 418/815] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 09:53:56 2022] GET /identity/v3/services => generated 1728 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:59.274503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531861b-2c4e-4d51-974c-3d289529adbe None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:59.275058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531861b-2c4e-4d51-974c-3d289529adbe None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:59.275058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531861b-2c4e-4d51-974c-3d289529adbe None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:59.276299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 398/816] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:59.282301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f69de-a1fa-47df-ba1a-14c5a8b90624 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:59.282738 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f69de-a1fa-47df-ba1a-14c5a8b90624 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:59.282838 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f69de-a1fa-47df-ba1a-14c5a8b90624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:59.301450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b38f69de-a1fa-47df-ba1a-14c5a8b90624 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:59.302669 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b38f69de-a1fa-47df-ba1a-14c5a8b90624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:59.331695 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:59.376321 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 419/817] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:59 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:53:59.707403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531861b-2c4e-4d51-974c-3d289529adbe None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:59.808509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531861b-2c4e-4d51-974c-3d289529adbe None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:59.842014 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:59.842634 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:59.842919 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:59.843445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:59.844043 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:59.845596 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:53:59.854333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:53:59.855593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:53:59.856523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 399/818] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:53:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:53:59.861964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f69de-a1fa-47df-ba1a-14c5a8b90624 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:59.958712 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f69de-a1fa-47df-ba1a-14c5a8b90624 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:59.992243 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:59.992871 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:59.993152 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:59.993418 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:59.994033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:59.994332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:59.995691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:00.001004 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 420/819] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:53:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:54:00.006718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:00.025652 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:00.104069 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6ccef-9835-4c2e-a55f-c82e55902744 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:00.139831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44a1a9-22fb-44f8-9102-5cf1e137941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:00.140431 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a1a9-22fb-44f8-9102-5cf1e137941d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:00.140747 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a1a9-22fb-44f8-9102-5cf1e137941d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:00.141023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a1a9-22fb-44f8-9102-5cf1e137941d None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:00.141643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44a1a9-22fb-44f8-9102-5cf1e137941d None admin] RBAC: Adding query filter params (type=compute) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:54:00.141944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44a1a9-22fb-44f8-9102-5cf1e137941d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:00.143304 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44a1a9-22fb-44f8-9102-5cf1e137941d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:00.147986 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 400/820] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 24 09:54:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:54:00.154481 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:00.182513 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:00.253423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4e6e-e1b4-4cc2-98ec-6239e48ad4fd None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:00.289708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb013e9-e638-4ef4-a1c1-8be62a2d5935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:00.290418 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb013e9-e638-4ef4-a1c1-8be62a2d5935 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:00.290581 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb013e9-e638-4ef4-a1c1-8be62a2d5935 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:00.290850 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb013e9-e638-4ef4-a1c1-8be62a2d5935 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:00.291513 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb013e9-e638-4ef4-a1c1-8be62a2d5935 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:00.292933 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb013e9-e638-4ef4-a1c1-8be62a2d5935 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:00.314095 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 421/821] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 09:54:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:54:10.145593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=59 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:10.309865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:05.367866 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534332-f030-4017-8ec7-237e7f565ee6 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:05.368571 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534332-f030-4017-8ec7-237e7f565ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:05.368571 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534332-f030-4017-8ec7-237e7f565ee6 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:05.369963 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 401/822] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:05.379466 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4740-0ddf-4603-a9be-a565020e7b5f None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:05.380069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4740-0ddf-4603-a9be-a565020e7b5f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:05.380069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4740-0ddf-4603-a9be-a565020e7b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:05.406397 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-956b4740-0ddf-4603-a9be-a565020e7b5f None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:05.408061 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-956b4740-0ddf-4603-a9be-a565020e7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:05.519685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 422/823] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:05 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:55:05.848620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c534332-f030-4017-8ec7-237e7f565ee6 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:06.029461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c534332-f030-4017-8ec7-237e7f565ee6 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:06.081312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:06.081921 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:06.082200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:06.082482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:06.095939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:06.097633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:06.123023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:06.124484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:06.125609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:06.125609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:06.125609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:06.125609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 402/824] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:06.131809 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b4740-0ddf-4603-a9be-a565020e7b5f None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:06.295536 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b4740-0ddf-4603-a9be-a565020e7b5f None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:06.334895 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:06.354344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5bb51-001b-45ab-ba84-02d72b66982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:06.356003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5bb51-001b-45ab-ba84-02d72b66982e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:06.356339 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5bb51-001b-45ab-ba84-02d72b66982e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:06.356747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5bb51-001b-45ab-ba84-02d72b66982e None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:06.357702 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5bb51-001b-45ab-ba84-02d72b66982e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:06.357896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5bb51-001b-45ab-ba84-02d72b66982e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:06.359742 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5bb51-001b-45ab-ba84-02d72b66982e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:06.375313 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 423/825] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:06.381786 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:06.458638 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:06.536472 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7baa8-6b72-44ae-9f37-785c8170b7c9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:06.588518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73caee-57c3-4584-8b79-b42a29a42b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:06.589293 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73caee-57c3-4584-8b79-b42a29a42b2b None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:06.590233 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73caee-57c3-4584-8b79-b42a29a42b2b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:06.590623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73caee-57c3-4584-8b79-b42a29a42b2b None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:06.591357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73caee-57c3-4584-8b79-b42a29a42b2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:06.593208 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73caee-57c3-4584-8b79-b42a29a42b2b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:06.653849 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 403/826] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 24 09:55:06 2022] POST /identity/v3/users => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:55:09.050688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1cd0-90d2-437e-9171-50d22dcacf48 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:09.051650 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1cd0-90d2-437e-9171-50d22dcacf48 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:09.051650 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1cd0-90d2-437e-9171-50d22dcacf48 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:09.052630 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 424/827] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:09.060292 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2ce2-2db9-4ee3-91b5-e8ca431f6471 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:09.060911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2ce2-2db9-4ee3-91b5-e8ca431f6471 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:09.061425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2ce2-2db9-4ee3-91b5-e8ca431f6471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:09.087795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-d3af2ce2-2db9-4ee3-91b5-e8ca431f6471 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:09.090544 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-d3af2ce2-2db9-4ee3-91b5-e8ca431f6471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:09.196329 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 404/828] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:09 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:55:09.561853 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1cd0-90d2-437e-9171-50d22dcacf48 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:09.717387 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1cd0-90d2-437e-9171-50d22dcacf48 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:09.765498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee0941-83ee-450b-ab81-4b01629fea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:09.765997 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee0941-83ee-450b-ab81-4b01629fea7d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:09.766273 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee0941-83ee-450b-ab81-4b01629fea7d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:09.766537 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee0941-83ee-450b-ab81-4b01629fea7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:09.779159 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee0941-83ee-450b-ab81-4b01629fea7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-2aee0941-83ee-450b-ab81-4b01629fea7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:55:09.784300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:09.786424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:09.788518 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 425/829] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:55:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:55:09.797165 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af2ce2-2db9-4ee3-91b5-e8ca431f6471 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:09.852238 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:09.944991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af2ce2-2db9-4ee3-91b5-e8ca431f6471 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:09.985715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:09.986386 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:09.986665 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:09.986959 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:09.987704 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:09.987990 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:09.989581 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:10.001192 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 405/830] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:55:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:10.007843 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee0941-83ee-450b-ab81-4b01629fea7d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:10.078472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:10.150983 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee0941-83ee-450b-ab81-4b01629fea7d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:10.197339 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:10.198917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:10.199173 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:10.199717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:10.213872 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:10.216055 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:10.238573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:10.245147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:10.247026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:10.247026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:10.247026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:10.247026 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 426/831] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:10.247716 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:10.390430 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:10.394628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3849b9-6ecd-4138-a001-6d488b567667 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:10.441277 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:10.442169 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:10.442522 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:10.442932 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:10.444018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:10.444324 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:10.446326 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:10.463420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 406/832] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:10.470410 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:10.619095 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:10.627526 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec52a66-726a-41b7-8337-c265e7520321 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:10.667300 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:10.668486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:10.668805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:10.669180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:10.680256 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:10.681894 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:55:10.697071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:10.698226 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:10.699283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 427/833] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:10.704708 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:10.847300 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b2151-0c81-432d-9ecf-131f5ef03662 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:10.903362 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:10.903940 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:10.904245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:10.904554 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:10.905364 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:10.905670 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:10.907123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:10.933405 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 407/834] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 09:55:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:55:10.941594 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:11.105287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caadbda-a630-45c4-a811-52e528102186 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:11.161098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9205f9-f85b-436f-9b91-d69407a13759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:11.161817 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9205f9-f85b-436f-9b91-d69407a13759 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:11.162008 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9205f9-f85b-436f-9b91-d69407a13759 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:11.162277 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9205f9-f85b-436f-9b91-d69407a13759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:11.197807 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:11.250156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9205f9-f85b-436f-9b91-d69407a13759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:11.251711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9205f9-f85b-436f-9b91-d69407a13759 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:11.421784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 428/835] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:55:10 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:55:11.429311 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:11.455661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:11.564344 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ddeb-ab6a-48dd-a912-697f75741516 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:11.614016 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:11.614739 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:11.615065 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:11.615375 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:11.627785 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:11.629408 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:11.654925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:11.656387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:11.657869 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:11.657869 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:11.657869 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:11.657869 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 408/836] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:55:11.665898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9205f9-f85b-436f-9b91-d69407a13759 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:11.775062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:11.833673 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9205f9-f85b-436f-9b91-d69407a13759 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:11.890532 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:11.891403 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:11.891820 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:11.892105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:11.893176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:11.893598 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:11.895431 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:11.912427 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 429/837] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:11.920102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:12.011700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:12.058857 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba447437-9871-4367-b93b-ce8830ed069c None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:12.110724 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:12.111373 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:12.111633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:12.111936 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:12.119838 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:12.121404 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:55:12.133582 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:12.135303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:12.137389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:55:12.137389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:55:12.137389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:55:12.137389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:55:12.137389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:55:12.137389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:55:12.137389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:12.137389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:12.140493 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 409/838] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:12.142335 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:12.311175 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ef938-9ee6-400e-ad29-6d3bc0668362 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:12.339036 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:12.364133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fab0-6100-4913-8450-1ac476d849b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:12.364909 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fab0-6100-4913-8450-1ac476d849b6 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:12.365268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fab0-6100-4913-8450-1ac476d849b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:12.365573 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fab0-6100-4913-8450-1ac476d849b6 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:12.366386 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fab0-6100-4913-8450-1ac476d849b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:12.370813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fab0-6100-4913-8450-1ac476d849b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:12.370813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fab0-6100-4913-8450-1ac476d849b6 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:12.388225 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 430/839] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:55:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:12.394659 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:12.542619 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be915ddd-4daa-45fc-ae91-1a36f5cc1a70 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:12.598324 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:12.608508 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e86d1-848c-41d1-a649-7befb61bc453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:12.609503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e86d1-848c-41d1-a649-7befb61bc453 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:12.609973 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e86d1-848c-41d1-a649-7befb61bc453 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:12.610500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e86d1-848c-41d1-a649-7befb61bc453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:12.611779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e86d1-848c-41d1-a649-7befb61bc453 None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=520fac97915740c38318e2a8664cc4c1) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:12.612298 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e86d1-848c-41d1-a649-7befb61bc453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:12.614482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e86d1-848c-41d1-a649-7befb61bc453 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:12.622521 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 410/840] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:55:12 2022] GET /identity/v3/role_assignments?user.id=520fac97915740c38318e2a8664cc4c1&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:15.035478 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c9b37-c4cc-4476-979a-44872bdd07c5 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:15.036270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c9b37-c4cc-4476-979a-44872bdd07c5 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:15.036270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c9b37-c4cc-4476-979a-44872bdd07c5 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:15.037761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 431/841] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:15.046465 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d3e58-4ed8-4bda-be48-fd6ef9ff9010 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:15.047048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d3e58-4ed8-4bda-be48-fd6ef9ff9010 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:15.047161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d3e58-4ed8-4bda-be48-fd6ef9ff9010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:15.066904 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-904d3e58-4ed8-4bda-be48-fd6ef9ff9010 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:15.068156 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-904d3e58-4ed8-4bda-be48-fd6ef9ff9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:15.149297 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 411/842] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:15 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:55:15.516131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c9b37-c4cc-4476-979a-44872bdd07c5 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:15.674512 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c9b37-c4cc-4476-979a-44872bdd07c5 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:15.715339 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a813885-6f02-4e45-94c8-50dcef741c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:15.715994 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a813885-6f02-4e45-94c8-50dcef741c89 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:15.716268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a813885-6f02-4e45-94c8-50dcef741c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:15.716538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a813885-6f02-4e45-94c8-50dcef741c89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:15.732517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a813885-6f02-4e45-94c8-50dcef741c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-8a813885-6f02-4e45-94c8-50dcef741c89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:55:15.737813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:15.740082 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:15.741958 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 432/843] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:55:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:15.746335 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d3e58-4ed8-4bda-be48-fd6ef9ff9010 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:15.904139 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d3e58-4ed8-4bda-be48-fd6ef9ff9010 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:15.931421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:15.944792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:15.945349 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:15.945633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:15.945906 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:15.946624 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:15.946930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:15.948377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:15.957852 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 412/844] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:55:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:15.963808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a813885-6f02-4e45-94c8-50dcef741c89 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:16.011945 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:16.091574 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a813885-6f02-4e45-94c8-50dcef741c89 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:16.136626 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:16.137310 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:16.137591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:16.137868 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:16.149880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:16.151468 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:16.171205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:16.172955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:16.174781 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:16.174781 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:16.174781 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:16.174781 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 433/845] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:16.179905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:16.311767 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c09e-79f1-4c17-a6e0-c8cde61939e9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:16.360455 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:16.361198 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:16.361462 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:16.361735 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:16.362423 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:16.362726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:16.364265 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:16.383745 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 413/846] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:16.390735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:16.521504 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:16.534724 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8890948-a2fd-4cb5-a963-3f83d36a450d None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:16.582744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:16.583809 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:16.584280 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:16.584820 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:16.598582 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:16.600789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:55:16.620034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:16.622400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:16.624249 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 434/847] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:16.630403 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:16.700380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:16.769155 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fec097-3857-46f0-8c70-89a205e0c5c2 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:16.820825 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:16.821721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:16.822031 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:16.822394 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:16.823171 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:16.823492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:16.825364 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:16.851876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 414/848] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 09:55:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:16.853767 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:16.988301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4c115-9ca3-4604-92b7-bcfc55a42d47 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:17.038436 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:17.039147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:17.039441 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:17.039711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:17.052788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:17.054335 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:17.070670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:17.071934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:17.072936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:17.072936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:17.072936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:17.072936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 435/849] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:17.078740 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:17.210368 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed0aba-ff6e-495e-9e76-c10338b92062 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:17.212982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:17.249071 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:17.249942 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:17.250342 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:17.250742 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:17.251480 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:17.252013 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:17.253583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:17.266474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 415/850] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:17.272498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:17.275974 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:17.408747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ddb52-fccb-413a-b1ae-1782bb647de8 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:17.451962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:17.453527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:17.453527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:17.453527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:17.461073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:17.462532 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:55:17.475587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:17.476629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:17.477940 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 436/851] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:17.483468 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:17.629567 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85186-4621-46e5-91c9-59c60f48fc27 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:17.687398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6963a-fdc0-4dca-bc95-13ef06ebedfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:17.688114 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6963a-fdc0-4dca-bc95-13ef06ebedfb None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:17.688459 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6963a-fdc0-4dca-bc95-13ef06ebedfb None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:17.688864 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6963a-fdc0-4dca-bc95-13ef06ebedfb None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:17.690049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6963a-fdc0-4dca-bc95-13ef06ebedfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:17.690341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6963a-fdc0-4dca-bc95-13ef06ebedfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:17.692316 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6963a-fdc0-4dca-bc95-13ef06ebedfb None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:17.709962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 416/852] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:55:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:17.717485 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:17.802971 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:17.859775 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e393d9b-5b84-4e03-9486-c2430f15a8d5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:17.901221 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c848b-c2cf-4a92-9ef3-93a5bcb6e153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:17.902495 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c848b-c2cf-4a92-9ef3-93a5bcb6e153 None admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:17.902785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c848b-c2cf-4a92-9ef3-93a5bcb6e153 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:17.903064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c848b-c2cf-4a92-9ef3-93a5bcb6e153 None admin] PATH_INFO: `/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/520fac97915740c38318e2a8664cc4c1/roles/de1e47b3393d4aaa872b8134a9578058` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:17.922186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c848b-c2cf-4a92-9ef3-93a5bcb6e153 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64d42bc4e7840c194ea6c42c4b1be8e, user_id=520fac97915740c38318e2a8664cc4c1, role_id=de1e47b3393d4aaa872b8134a9578058)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:17.923728 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c848b-c2cf-4a92-9ef3-93a5bcb6e153 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:17.939609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 437/853] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:55:17 2022] PUT /identity/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/520fac97915740c38318e2a8664cc4c1/roles/de1e47b3393d4aaa872b8134a9578058 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:55:20.137862 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc113d9e-28c0-4917-9ea2-3c02530c91f0 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:20.138425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc113d9e-28c0-4917-9ea2-3c02530c91f0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:20.138425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc113d9e-28c0-4917-9ea2-3c02530c91f0 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:20.139734 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 417/854] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:20.145181 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20fe7-996a-4d6a-90b3-9f2dd5d5184a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:20.145715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20fe7-996a-4d6a-90b3-9f2dd5d5184a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:20.145715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd20fe7-996a-4d6a-90b3-9f2dd5d5184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:20.164202 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ebd20fe7-996a-4d6a-90b3-9f2dd5d5184a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:20.165344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ebd20fe7-996a-4d6a-90b3-9f2dd5d5184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:20.244128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 438/855] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:55:20.569126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc113d9e-28c0-4917-9ea2-3c02530c91f0 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:20.603795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:20.699817 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc113d9e-28c0-4917-9ea2-3c02530c91f0 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:20.742189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3530-5a89-4ce2-bbef-2e1becbda975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:20.742845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3530-5a89-4ce2-bbef-2e1becbda975 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:20.743128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3530-5a89-4ce2-bbef-2e1becbda975 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:20.743401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e3530-5a89-4ce2-bbef-2e1becbda975 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:20.755281 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e3530-5a89-4ce2-bbef-2e1becbda975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d10e3530-5a89-4ce2-bbef-2e1becbda975 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:55:20.759952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:20.761220 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:20.762075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 418/856] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 24 09:55:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:20.767346 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20fe7-996a-4d6a-90b3-9f2dd5d5184a None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:20.814429 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:20.885000 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd20fe7-996a-4d6a-90b3-9f2dd5d5184a None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:20.931431 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:20.932176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:20.932456 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:20.932789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:20.934093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:20.934404 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:20.935851 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:20.946491 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 439/857] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 24 09:55:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:20.952987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3530-5a89-4ce2-bbef-2e1becbda975 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:21.046875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:21.066063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e3530-5a89-4ce2-bbef-2e1becbda975 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:21.114158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:21.115085 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:21.115398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:21.115784 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:21.128685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:21.130365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:21.147774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:21.149306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:21.150222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:21.150222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:21.150222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:21.150222 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 419/858] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:21.155963 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:21.271409 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c84ba-65c9-4e71-88fb-2e6630999ef1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:21.274454 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:21.310453 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:21.311060 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:21.311331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:21.311641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:21.312232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:21.312527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:21.313920 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:21.326789 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 440/859] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:21.333036 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:21.452193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f90691-08c2-4536-b540-d24f0f3c0309 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:21.493872 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:21.494659 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:21.495039 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:21.495475 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] PATH_INFO: `/v3/users/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:21.499741 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:21.506544 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:21.509041 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:55:21.525427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:21.526517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:21.528053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 420/860] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:21.534343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:21.671785 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846df46-b136-4a65-9da3-fc4d06d14943 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:21.720145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:21.720706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:21.720988 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:21.721260 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:21.721994 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:21.722296 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:21.723723 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:21.744975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 441/861] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 09:55:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:21.751259 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:21.863040 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e04c6-7151-472e-8972-2cba48b27aea None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:21.903174 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49938284-9271-472f-9bd1-07cf91f608c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:21.903796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49938284-9271-472f-9bd1-07cf91f608c9 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:21.904185 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49938284-9271-472f-9bd1-07cf91f608c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:21.904463 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49938284-9271-472f-9bd1-07cf91f608c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:21.979492 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:21.986377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49938284-9271-472f-9bd1-07cf91f608c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:21.987909 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49938284-9271-472f-9bd1-07cf91f608c9 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:22.103800 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 421/862] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:55:21 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:55:22.105505 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:22.136901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:22.265561 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d2bbb-5628-4203-b4df-911c426610a5 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:22.318938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:22.320200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:22.320808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:22.321330 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:22.335495 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:22.337515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:22.365957 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:22.367084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:22.368209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:22.368209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:22.368209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:22.368209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 442/863] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:55:22.375256 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49938284-9271-472f-9bd1-07cf91f608c9 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:22.513910 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:22.521770 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49938284-9271-472f-9bd1-07cf91f608c9 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:22.577185 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff796e4-a652-474d-b206-93047d755601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:22.578175 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff796e4-a652-474d-b206-93047d755601 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:22.578608 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff796e4-a652-474d-b206-93047d755601 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:22.578904 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff796e4-a652-474d-b206-93047d755601 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:22.579550 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff796e4-a652-474d-b206-93047d755601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:22.579847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff796e4-a652-474d-b206-93047d755601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:22.582298 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff796e4-a652-474d-b206-93047d755601 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:22.598627 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 422/864] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:22.606496 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:22.719503 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:22.748948 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ec506-dc67-4aa9-90b3-09b41a210d42 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:22.787200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:22.787753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:22.788062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:22.788343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:22.796577 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:22.798187 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:55:22.810324 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:22.811472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:22.812461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:55:22.812461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:55:22.812461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:55:22.812461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:55:22.812461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:55:22.812461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:55:22.812461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:22.812461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:22.816343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 443/865] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:22.817477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff796e4-a652-474d-b206-93047d755601 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:22.935392 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff796e4-a652-474d-b206-93047d755601 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:22.972249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551900ff-cdb8-4ce2-bc65-a544de639a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:22.972887 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551900ff-cdb8-4ce2-bc65-a544de639a56 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:22.973207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551900ff-cdb8-4ce2-bc65-a544de639a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:22.973482 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551900ff-cdb8-4ce2-bc65-a544de639a56 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:22.974174 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551900ff-cdb8-4ce2-bc65-a544de639a56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:22.974523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551900ff-cdb8-4ce2-bc65-a544de639a56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:22.976094 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551900ff-cdb8-4ce2-bc65-a544de639a56 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:22.989223 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 423/866] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:22.995431 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:23.105065 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4ec8a-05ff-4f15-8c82-9b57590592a1 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:23.145009 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346246d-4cb5-4131-a662-f9d390a6f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:23.145679 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346246d-4cb5-4131-a662-f9d390a6f845 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:23.146024 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346246d-4cb5-4131-a662-f9d390a6f845 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:23.146245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346246d-4cb5-4131-a662-f9d390a6f845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:23.147053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346246d-4cb5-4131-a662-f9d390a6f845 None admin] RBAC: Adding query filter params (role.id=de1e47b3393d4aaa872b8134a9578058, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=520fac97915740c38318e2a8664cc4c1) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:23.147360 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346246d-4cb5-4131-a662-f9d390a6f845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:23.148981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346246d-4cb5-4131-a662-f9d390a6f845 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:23.150835 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:23.156917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 444/867] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:55:22 2022] GET /identity/v3/role_assignments?user.id=520fac97915740c38318e2a8664cc4c1&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=de1e47b3393d4aaa872b8134a9578058 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:25.452902 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5d27-d273-405d-8adb-94f78f242483 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:25.453710 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5d27-d273-405d-8adb-94f78f242483 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:25.453710 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5d27-d273-405d-8adb-94f78f242483 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:25.454928 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 424/868] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:25.460499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac08c6-198c-4a16-90a7-eccf34fc4821 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:25.461021 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac08c6-198c-4a16-90a7-eccf34fc4821 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:25.461134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac08c6-198c-4a16-90a7-eccf34fc4821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:25.481107 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-41ac08c6-198c-4a16-90a7-eccf34fc4821 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:25.482381 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-41ac08c6-198c-4a16-90a7-eccf34fc4821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:25.559483 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 445/869] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:25 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:55:25.891535 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea5d27-d273-405d-8adb-94f78f242483 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:25.911935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:26.008954 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea5d27-d273-405d-8adb-94f78f242483 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:26.049862 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba70a2-eacf-4e4f-8c1b-20085cbd16ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:26.050672 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba70a2-eacf-4e4f-8c1b-20085cbd16ee None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:26.051060 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba70a2-eacf-4e4f-8c1b-20085cbd16ee None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:26.051436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba70a2-eacf-4e4f-8c1b-20085cbd16ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:26.064151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba70a2-eacf-4e4f-8c1b-20085cbd16ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-d3ba70a2-eacf-4e4f-8c1b-20085cbd16ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:55:26.069200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:26.070398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:26.071389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 425/870] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:26.076651 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac08c6-198c-4a16-90a7-eccf34fc4821 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:26.190490 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac08c6-198c-4a16-90a7-eccf34fc4821 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:26.220505 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:26.230764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:26.231476 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:26.231828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:26.232099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:26.232818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:26.233120 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:26.234531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:26.243633 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 446/871] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:26.250382 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba70a2-eacf-4e4f-8c1b-20085cbd16ee None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:26.346723 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:26.377066 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba70a2-eacf-4e4f-8c1b-20085cbd16ee None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:26.420543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:26.421245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:26.421588 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:26.421913 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:26.434283 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:26.435786 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:26.451502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:26.452561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:26.454075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:26.454075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:26.454075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:26.454075 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 426/872] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:26.458701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:26.574585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1cb44-9f4c-4dd8-ba2c-3de7b15dde42 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:26.615868 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:26.616493 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:26.616818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:26.617092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:26.617794 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:26.618049 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:26.619468 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:26.638674 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 447/873] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:26.645015 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:26.772850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f5e8-9767-4346-b0d5-09fb8461a564 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:26.804258 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:26.812445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:26.813112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:26.813392 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:26.813660 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:26.821867 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:26.823792 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:55:26.835601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:26.836699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:26.838050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 427/874] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:26.843677 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:26.902369 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:26.956738 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a41a-55f5-4db3-bdc0-c84cd52dee91 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:27.001632 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:27.002690 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:27.003207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:27.003705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:27.004795 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:27.005325 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:27.007444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:27.032276 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 448/875] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 09:55:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:27.038211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:27.181511 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c231a5-6614-4f94-a38e-25344ee34045 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:27.220310 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35357a3-9046-4dc9-884f-5fd91209307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:27.220988 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35357a3-9046-4dc9-884f-5fd91209307b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:27.221236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35357a3-9046-4dc9-884f-5fd91209307b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:27.221516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35357a3-9046-4dc9-884f-5fd91209307b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:27.301443 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:27.317628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35357a3-9046-4dc9-884f-5fd91209307b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:27.319118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35357a3-9046-4dc9-884f-5fd91209307b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:27.443548 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 428/876] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:55:27 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:55:27.449832 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:27.576577 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f22e7-9bac-4ee6-b957-a6cab441b017 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:27.589642 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:27.626987 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:27.627714 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:27.627995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:27.628297 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:27.642211 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:27.644141 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:27.663932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:27.665034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:27.666210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:27.666210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:27.666210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:27.666210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 449/877] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:27.674349 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35357a3-9046-4dc9-884f-5fd91209307b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:27.797230 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:27.812237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35357a3-9046-4dc9-884f-5fd91209307b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:27.857423 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:27.857937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:27.858196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:27.858485 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:27.859140 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:27.859442 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:27.860893 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:27.877070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 429/878] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:27.883546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:28.010491 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272363cd-53d0-41f2-9dc5-8ad093914432 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:28.052061 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:28.052817 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:28.053098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:28.053373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:28.061257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:28.062725 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:55:28.079878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:28.080993 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:28.081905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 450/879] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:55:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:55:28.087633 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:28.220024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e14a2-906e-4619-8d94-af8a632d7f6e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:28.258529 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc70568-0c23-482e-bed6-b1ce6e264186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:28.259145 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70568-0c23-482e-bed6-b1ce6e264186 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:28.259422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70568-0c23-482e-bed6-b1ce6e264186 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:28.259693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70568-0c23-482e-bed6-b1ce6e264186 None admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:28.260377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc70568-0c23-482e-bed6-b1ce6e264186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:28.260714 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc70568-0c23-482e-bed6-b1ce6e264186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:28.262666 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc70568-0c23-482e-bed6-b1ce6e264186 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:28.275906 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 430/880] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:55:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:28.282869 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:28.308643 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:28.400318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829bde5-799f-469d-b655-7d1deca8ddc2 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:28.438844 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91111c99-6148-4698-8a6c-d2611d5559a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:28.439448 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111c99-6148-4698-8a6c-d2611d5559a2 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:28.439723 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111c99-6148-4698-8a6c-d2611d5559a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:28.439992 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111c99-6148-4698-8a6c-d2611d5559a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:28.440783 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111c99-6148-4698-8a6c-d2611d5559a2 None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=520fac97915740c38318e2a8664cc4c1) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:28.441104 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111c99-6148-4698-8a6c-d2611d5559a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:28.442528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111c99-6148-4698-8a6c-d2611d5559a2 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:28.448869 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 451/881] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:55:28 2022] GET /identity/v3/role_assignments?user.id=520fac97915740c38318e2a8664cc4c1&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:30.647542 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909911d-de1d-4e9f-a143-320f3de9ff54 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:30.648186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909911d-de1d-4e9f-a143-320f3de9ff54 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:30.648186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909911d-de1d-4e9f-a143-320f3de9ff54 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:30.649991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 431/882] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:30.656590 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7ed1-8a73-4ff4-ac1f-4df140403d50 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:30.657458 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7ed1-8a73-4ff4-ac1f-4df140403d50 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:30.657667 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7ed1-8a73-4ff4-ac1f-4df140403d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:30.679220 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-7e1e7ed1-8a73-4ff4-ac1f-4df140403d50 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:30.680540 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-7e1e7ed1-8a73-4ff4-ac1f-4df140403d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:30.750706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 452/883] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:30 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:55:31.074092 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909911d-de1d-4e9f-a143-320f3de9ff54 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:31.085193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:31.181977 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909911d-de1d-4e9f-a143-320f3de9ff54 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:31.224763 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a02d6-3c6b-49af-a8f8-09a12c7f4841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:31.225410 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a02d6-3c6b-49af-a8f8-09a12c7f4841 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:31.225692 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a02d6-3c6b-49af-a8f8-09a12c7f4841 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:31.225961 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a02d6-3c6b-49af-a8f8-09a12c7f4841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:31.237095 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a02d6-3c6b-49af-a8f8-09a12c7f4841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-4c9a02d6-3c6b-49af-a8f8-09a12c7f4841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:55:31.241818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:31.242980 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:31.244105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 432/884] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:31.249060 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7ed1-8a73-4ff4-ac1f-4df140403d50 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:31.264471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:31.352941 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7ed1-8a73-4ff4-ac1f-4df140403d50 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:31.387143 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:31.387762 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:31.388041 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:31.388313 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:31.389034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:31.389334 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:31.390747 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:31.399818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 453/885] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:31.406343 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a02d6-3c6b-49af-a8f8-09a12c7f4841 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:31.473400 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:31.506138 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a02d6-3c6b-49af-a8f8-09a12c7f4841 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:31.540515 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:31.541168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:31.541447 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:31.541719 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:31.552648 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:31.554144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:31.569675 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:31.570984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:31.571915 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:31.571915 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:31.571915 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:31.571915 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 433/886] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:31.578696 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:31.688527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:31.713323 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ff0a1-ceb7-4f5a-8a33-e5aa675fefa8 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:31.752237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:31.752803 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:31.753091 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:31.753370 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:31.754034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:31.754339 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:31.755750 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:31.769158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 454/887] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:31.775118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:31.877183 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaec125-f34f-4f79-a94d-6ea782dfc5eb None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:31.897169 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:31.911527 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:31.912158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:31.912441 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:31.912751 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:31.921690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:31.923123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:55:31.934805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:31.935987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:31.937246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 434/888] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:31.941721 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:32.038396 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4837bd-6b2a-4df8-bdf9-29b001fcaa41 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:32.076139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:32.076807 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:32.077090 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:32.077373 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:32.078117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:32.078458 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:32.079926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:32.083086 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:32.100137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 455/889] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 09:55:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:32.107246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:32.274213 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72309ce6-ebbb-4b7b-9a32-f900fb58ff8e None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:32.331447 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:32.332456 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:32.332956 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:32.333434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:32.352586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:32.355976 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:32.383177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:32.384434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:32.385606 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:32.385606 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:32.385606 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:32.385606 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 435/890] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:32.391121 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:32.494609 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6cbdf-18da-4b8a-8776-fdcfefab428f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:32.530257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:32.530868 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:32.531151 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:32.531425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:32.532063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:32.532364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:32.533800 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:32.546056 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 456/891] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:32.552357 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:32.597975 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:32.679518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e3c2-3351-41c2-9427-b36711da6f8d None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:32.714996 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:32.715628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:32.715906 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:32.716172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:32.723260 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:32.724734 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:55:32.735937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:32.737124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:32.738429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 436/892] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:55:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:32.742952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:32.801703 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:32.851896 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb00e2-1cf3-4080-9b9d-6955ee46cd2f None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:32.886582 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078e2f5-3133-41c6-8481-ce9eab626e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:32.887187 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e2f5-3133-41c6-8481-ce9eab626e41 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:32.887464 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e2f5-3133-41c6-8481-ce9eab626e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:32.887737 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e2f5-3133-41c6-8481-ce9eab626e41 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:32.888423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078e2f5-3133-41c6-8481-ce9eab626e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:32.888754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078e2f5-3133-41c6-8481-ce9eab626e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:32.890186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078e2f5-3133-41c6-8481-ce9eab626e41 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:32.902669 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 457/893] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:32.909294 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:32.997766 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:33.006491 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff0453-8f9e-42ee-8f78-2f7514818c6b None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:33.041577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27d6ac-d905-48ce-9387-1206c6f4fcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:33.042268 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27d6ac-d905-48ce-9387-1206c6f4fcda None admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:33.042549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27d6ac-d905-48ce-9387-1206c6f4fcda None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:33.042826 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27d6ac-d905-48ce-9387-1206c6f4fcda None admin] PATH_INFO: `/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/520fac97915740c38318e2a8664cc4c1/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:33.044760 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27d6ac-d905-48ce-9387-1206c6f4fcda None admin] RBAC: Authorizing `identity:create_grant(project_id=e64d42bc4e7840c194ea6c42c4b1be8e, user_id=520fac97915740c38318e2a8664cc4c1, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:33.046192 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27d6ac-d905-48ce-9387-1206c6f4fcda None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:33.059734 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 437/894] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 24 09:55:32 2022] PUT /identity/v3/projects/e64d42bc4e7840c194ea6c42c4b1be8e/users/520fac97915740c38318e2a8664cc4c1/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:55:35.322412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6031a4-484b-4919-a73a-c1e980908ab9 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:35.323048 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6031a4-484b-4919-a73a-c1e980908ab9 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:35.323048 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6031a4-484b-4919-a73a-c1e980908ab9 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:35.324329 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 458/895] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:35.329836 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d116-ea10-4a4d-8175-65a764df08ab None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:35.330333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d116-ea10-4a4d-8175-65a764df08ab None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:35.330439 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d116-ea10-4a4d-8175-65a764df08ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:35.349588 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3af2d116-ea10-4a4d-8175-65a764df08ab None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:35.350789 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3af2d116-ea10-4a4d-8175-65a764df08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:35.419642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 438/896] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:35 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:55:35.760552 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6031a4-484b-4919-a73a-c1e980908ab9 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:35.875392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6031a4-484b-4919-a73a-c1e980908ab9 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:35.890715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:35.911733 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99f7a-7207-4100-9468-136ad8134109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:35.912381 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99f7a-7207-4100-9468-136ad8134109 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:35.912699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99f7a-7207-4100-9468-136ad8134109 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:35.912962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99f7a-7207-4100-9468-136ad8134109 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:35.923907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce99f7a-7207-4100-9468-136ad8134109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-dce99f7a-7207-4100-9468-136ad8134109 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:55:35.928645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:35.929866 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:35.930996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 459/897] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 24 09:55:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:35.935816 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2d116-ea10-4a4d-8175-65a764df08ab None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:36.014779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:36.035161 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2d116-ea10-4a4d-8175-65a764df08ab None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:36.070531 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:36.071135 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:36.071418 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:36.071694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:36.072421 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:36.072714 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:36.074853 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:36.083547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 439/898] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 24 09:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:55:36.089503 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99f7a-7207-4100-9468-136ad8134109 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:36.192274 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99f7a-7207-4100-9468-136ad8134109 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:36.227075 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:36.227700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:36.227981 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:36.228257 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:36.238473 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:36.239930 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:36.256170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:36.258029 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:36.259251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:36.259251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:36.259251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:36.259251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 460/899] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:36.264225 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:36.362604 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e441d-28e7-4f58-8568-237c0bebaa52 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:36.397663 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:36.398256 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:36.398533 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:36.398802 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:36.399426 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:36.399724 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:36.401098 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:36.412390 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 440/900] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:36.419072 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:36.447032 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:36.523961 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108e1a2-3176-4a3b-b073-2eddce1573a0 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:36.557062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:36.558256 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:36.558538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:36.558813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:36.566290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:36.567754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:55:36.579913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:36.581460 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:36.582546 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 461/901] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:36.587747 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:36.592694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:36.702579 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883da6c-2f7d-4fca-aa67-db61ef76d865 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:36.736464 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:36.737092 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:36.737376 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:36.737648 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:36.738367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:36.738674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:36.740088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:36.757311 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 441/902] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 24 09:55:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:36.763188 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:36.848362 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:36.863938 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929524-aa95-4491-af04-0ba62603b739 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:36.899471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c21c-092c-4b73-a71e-62946664f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:36.900068 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c21c-092c-4b73-a71e-62946664f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:36.900351 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c21c-092c-4b73-a71e-62946664f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:36.900626 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6c21c-092c-4b73-a71e-62946664f5b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:36.967661 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6c21c-092c-4b73-a71e-62946664f5b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:36.969340 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6c21c-092c-4b73-a71e-62946664f5b4 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:37.048984 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:37.064552 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 462/903] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 24 09:55:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:55:37.070650 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:37.140865 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:37.179195 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c388ba-8d9b-4b4a-b426-20d6ad79b098 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:37.212526 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:37.213177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:37.213453 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:37.213721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:37.223824 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:37.225232 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:55:37.240003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:37.241200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:55:37.242518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:55:37.242518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:55:37.242518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:37.242518 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 442/904] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:37.248860 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c21c-092c-4b73-a71e-62946664f5b4 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:37.344315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6c21c-092c-4b73-a71e-62946664f5b4 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:37.378180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:37.378782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:37.379059 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:37.379331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:37.379972 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:37.380271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:37.381697 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:37.394623 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 463/905] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 24 09:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:37.400708 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:37.499250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1415-c2b4-4155-a975-ee29aba7fadd None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:37.512420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:37.533050 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:37.533687 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:37.533971 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:37.534246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:37.541085 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:37.543139 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:55:37.554905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:37.555841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: ERROR keystone.server.flask.application Aug 24 09:55:37.556846 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 443/906] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 24 09:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:37.562154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:37.609867 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:37.662149 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ce130-722a-4485-8479-2a8cea1fd140 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:37.697228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbb3c5-434f-49c7-9d3a-00b9eb455fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:37.697825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb3c5-434f-49c7-9d3a-00b9eb455fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:37.698129 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb3c5-434f-49c7-9d3a-00b9eb455fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:37.698399 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb3c5-434f-49c7-9d3a-00b9eb455fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:37.699078 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbb3c5-434f-49c7-9d3a-00b9eb455fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:37.699378 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbb3c5-434f-49c7-9d3a-00b9eb455fe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:37.700816 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbb3c5-434f-49c7-9d3a-00b9eb455fe1 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:37.713166 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 464/907] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 24 09:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:37.720171 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:37.822754 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa5e1-124d-44c5-ba9a-b9145701ff40 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:37.856623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0165327-2b34-4d42-a0e9-4972b50e80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:37.857244 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165327-2b34-4d42-a0e9-4972b50e80bd None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:37.857525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165327-2b34-4d42-a0e9-4972b50e80bd None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:37.857799 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165327-2b34-4d42-a0e9-4972b50e80bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:37.858515 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165327-2b34-4d42-a0e9-4972b50e80bd None admin] RBAC: Adding query filter params (role.id=e1d977f275a8474ea050e57e76d6e7e0, scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e, user.id=520fac97915740c38318e2a8664cc4c1) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:37.858821 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165327-2b34-4d42-a0e9-4972b50e80bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:37.860235 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165327-2b34-4d42-a0e9-4972b50e80bd None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:37.865921 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 444/908] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 24 09:55:37 2022] GET /identity/v3/role_assignments?user.id=520fac97915740c38318e2a8664cc4c1&scope.project.id=e64d42bc4e7840c194ea6c42c4b1be8e&role.id=e1d977f275a8474ea050e57e76d6e7e0 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:55:40.068590 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b21b7-2f95-4875-b871-9420396ec1f8 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:40.069134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b21b7-2f95-4875-b871-9420396ec1f8 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:40.069247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b21b7-2f95-4875-b871-9420396ec1f8 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:40.070475 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 465/909] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:40.076774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a61db-4550-4a3f-ad26-92996ec6ea2b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:40.077208 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a61db-4550-4a3f-ad26-92996ec6ea2b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:40.077329 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a61db-4550-4a3f-ad26-92996ec6ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:40.095732 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-dc5a61db-4550-4a3f-ad26-92996ec6ea2b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:40.096970 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-dc5a61db-4550-4a3f-ad26-92996ec6ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:40.127673 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:40.165718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 445/910] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:55:40.488043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b21b7-2f95-4875-b871-9420396ec1f8 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:40.609038 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b21b7-2f95-4875-b871-9420396ec1f8 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:40.618996 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:40.654764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:40.655907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:40.656297 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:40.656694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:40.657511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:40.659502 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:40.672131 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:40.677287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:40.678975 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 466/911] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 24 09:55:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:40.681757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a61db-4550-4a3f-ad26-92996ec6ea2b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:40.782813 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a61db-4550-4a3f-ad26-92996ec6ea2b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:40.820560 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419487e-d799-4b21-bf3a-de1765d78e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:40.821271 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419487e-d799-4b21-bf3a-de1765d78e62 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:40.821554 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419487e-d799-4b21-bf3a-de1765d78e62 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:40.821827 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419487e-d799-4b21-bf3a-de1765d78e62 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:40.824151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419487e-d799-4b21-bf3a-de1765d78e62 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:40.824151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419487e-d799-4b21-bf3a-de1765d78e62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:40.824151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419487e-d799-4b21-bf3a-de1765d78e62 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:40.829513 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 446/912] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 24 09:55:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:40.835449 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:40.942749 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4b76a-6b65-4753-b99d-f568a6961b13 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:40.977901 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba9f1c-753b-4243-a05d-0cde573cc1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:40.978498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9f1c-753b-4243-a05d-0cde573cc1e5 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:40.978772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9f1c-753b-4243-a05d-0cde573cc1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:40.979038 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba9f1c-753b-4243-a05d-0cde573cc1e5 None admin] PATH_INFO: `/v3/services` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:40.979691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba9f1c-753b-4243-a05d-0cde573cc1e5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:40.979983 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba9f1c-753b-4243-a05d-0cde573cc1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:40.981378 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba9f1c-753b-4243-a05d-0cde573cc1e5 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:40.985875 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 467/913] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 24 09:55:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:55:43.180642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f52f3-0216-4407-9d20-b6ae5a2c4cc6 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:43.181208 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f52f3-0216-4407-9d20-b6ae5a2c4cc6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:43.181208 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f52f3-0216-4407-9d20-b6ae5a2c4cc6 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:43.183006 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 447/914] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:43.188502 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4885-8da2-4b12-9543-037accabf6a6 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:43.189046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4885-8da2-4b12-9543-037accabf6a6 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:43.189142 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4885-8da2-4b12-9543-037accabf6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:43.206812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-beda4885-8da2-4b12-9543-037accabf6a6 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:43.207997 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-beda4885-8da2-4b12-9543-037accabf6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:43.234800 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:43.274739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 468/915] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:55:43.607276 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f52f3-0216-4407-9d20-b6ae5a2c4cc6 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:43.645803 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:43.725169 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f52f3-0216-4407-9d20-b6ae5a2c4cc6 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:43.759219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8212-c925-4c82-9c2b-6e9af3b88f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:43.759825 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8212-c925-4c82-9c2b-6e9af3b88f59 None admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:43.760107 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8212-c925-4c82-9c2b-6e9af3b88f59 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:43.760409 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8212-c925-4c82-9c2b-6e9af3b88f59 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:43.761078 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f8212-c925-4c82-9c2b-6e9af3b88f59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:43.762455 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f8212-c925-4c82-9c2b-6e9af3b88f59 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:43.777793 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 448/916] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 24 09:55:43 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:55:45.975782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c169a-6421-4eed-a7b3-6de92f7cfa90 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:45.976415 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c169a-6421-4eed-a7b3-6de92f7cfa90 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:45.976415 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c169a-6421-4eed-a7b3-6de92f7cfa90 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:45.977703 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 469/917] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:45.983768 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1419d-f9f8-4dd7-bbb3-64a417bb0e78 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:45.984278 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1419d-f9f8-4dd7-bbb3-64a417bb0e78 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:45.984385 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1419d-f9f8-4dd7-bbb3-64a417bb0e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:46.003123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ddb1419d-f9f8-4dd7-bbb3-64a417bb0e78 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:46.004327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ddb1419d-f9f8-4dd7-bbb3-64a417bb0e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:46.077380 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 449/918] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:45 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:55:46.399220 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c169a-6421-4eed-a7b3-6de92f7cfa90 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:46.500525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c169a-6421-4eed-a7b3-6de92f7cfa90 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:46.542463 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:46.543130 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:46.543410 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:46.543685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:46.544292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:46.545793 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:46.555578 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:46.556916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:46.557864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 470/919] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 24 09:55:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:46.563515 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1419d-f9f8-4dd7-bbb3-64a417bb0e78 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:46.584359 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:46.670023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1419d-f9f8-4dd7-bbb3-64a417bb0e78 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:46.704029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:46.704638 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:46.704947 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:46.705219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:46.705848 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:46.706150 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:46.707520 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:46.713271 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 450/920] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 24 09:55:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:46.723815 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:46.772096 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:46.898129 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e220f88-a10e-4f1f-84f8-5d0e858f818e None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:46.956183 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731a0d-534a-43b9-a6ee-56980bae962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:46.957179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731a0d-534a-43b9-a6ee-56980bae962e None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:46.957692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731a0d-534a-43b9-a6ee-56980bae962e None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:46.958192 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731a0d-534a-43b9-a6ee-56980bae962e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:46.959505 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731a0d-534a-43b9-a6ee-56980bae962e None admin] RBAC: Adding query filter params (interface=public, service_id=5d47546163384215aa1e5f1a7af55bf5, region_id=RegionOne) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:46.960069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731a0d-534a-43b9-a6ee-56980bae962e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:46.962711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da731a0d-534a-43b9-a6ee-56980bae962e None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:46.972527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 471/921] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 24 09:55:46 2022] GET /identity/v3/endpoints?service_id=5d47546163384215aa1e5f1a7af55bf5&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:55:46.978621 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:47.058802 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:47.077021 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa505c2-b497-4485-afe1-c4ca96a0cff6 None admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:47.111121 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb55ea8-cc55-4228-babb-9faa374adf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:47.111721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55ea8-cc55-4228-babb-9faa374adf14 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:47.112028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55ea8-cc55-4228-babb-9faa374adf14 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:47.112297 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55ea8-cc55-4228-babb-9faa374adf14 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:47.112940 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb55ea8-cc55-4228-babb-9faa374adf14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:47.114304 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb55ea8-cc55-4228-babb-9faa374adf14 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:47.123679 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 451/922] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 24 09:55:46 2022] GET /identity/v3/services => generated 1962 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:55:49.310117 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c838c-d822-4ce8-af64-003cba97303f None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:49.310646 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c838c-d822-4ce8-af64-003cba97303f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:49.310646 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c838c-d822-4ce8-af64-003cba97303f None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:49.312124 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 472/923] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:49.318537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598bf5a-9658-4542-b784-445c40878d19 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:49.319049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598bf5a-9658-4542-b784-445c40878d19 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:49.319141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598bf5a-9658-4542-b784-445c40878d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:49.337877 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6598bf5a-9658-4542-b784-445c40878d19 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:49.339661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6598bf5a-9658-4542-b784-445c40878d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:49.410245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 452/924] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:49 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:55:49.738378 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c838c-d822-4ce8-af64-003cba97303f None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:49.830630 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:49.840511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c838c-d822-4ce8-af64-003cba97303f None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:49.874293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:49.874918 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:49.875194 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:49.875463 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:49.876025 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:49.877410 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:55:49.886332 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:55:49.887527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application with Lock( Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: ERROR keystone.server.flask.application Aug 24 09:55:49.888416 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 473/925] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 24 09:55:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:55:49.893481 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598bf5a-9658-4542-b784-445c40878d19 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:49.969947 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:49.994660 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598bf5a-9658-4542-b784-445c40878d19 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:50.028237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df326ed-a1fb-4116-9b6a-db780b7cf750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:50.028864 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df326ed-a1fb-4116-9b6a-db780b7cf750 None admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:50.029149 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df326ed-a1fb-4116-9b6a-db780b7cf750 None admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:50.029424 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df326ed-a1fb-4116-9b6a-db780b7cf750 None admin] PATH_INFO: `/v3/services` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:50.030051 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df326ed-a1fb-4116-9b6a-db780b7cf750 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:55:50.030356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df326ed-a1fb-4116-9b6a-db780b7cf750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:50.031721 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df326ed-a1fb-4116-9b6a-db780b7cf750 None admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:50.036669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 453/926] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 24 09:55:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:55:50.043020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:50.142684 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44962ed-cd17-49b4-b3c4-756d5247db18 None admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:50.175970 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd142-b31c-438e-a188-e346f2f40673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:50.176575 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd142-b31c-438e-a188-e346f2f40673 None admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:50.176887 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd142-b31c-438e-a188-e346f2f40673 None admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:50.177165 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd142-b31c-438e-a188-e346f2f40673 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:50.177822 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fd142-b31c-438e-a188-e346f2f40673 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:50.179195 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fd142-b31c-438e-a188-e346f2f40673 None admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:50.199765 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 474/927] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 09:55:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:56:00.033840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=30 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:00.195163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:52.792335 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8b3e-918b-455c-88df-34199062eaee None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:52.792944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8b3e-918b-455c-88df-34199062eaee None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:52.792944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8b3e-918b-455c-88df-34199062eaee None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:52.794707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 454/928] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:56:52.808408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082d18-1f1b-4458-8a37-a6a7603b4933 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:52.808989 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082d18-1f1b-4458-8a37-a6a7603b4933 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:52.809078 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082d18-1f1b-4458-8a37-a6a7603b4933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:52.830200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fe082d18-1f1b-4458-8a37-a6a7603b4933 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:52.831531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fe082d18-1f1b-4458-8a37-a6a7603b4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:52.928307 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 475/929] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:56:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:56:53.285642 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac0753-07da-4b52-a4ea-fbdc635ed43c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:53.285927 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac0753-07da-4b52-a4ea-fbdc635ed43c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:53.286206 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac0753-07da-4b52-a4ea-fbdc635ed43c None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:53.287554 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 455/930] 10.222.0.70 () {54 vars in 965 bytes} [Wed Aug 24 09:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:56:53.294515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca2e6-3cda-4171-b4c6-3425c75c7ead None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:53.294887 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca2e6-3cda-4171-b4c6-3425c75c7ead None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:53.295229 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca2e6-3cda-4171-b4c6-3425c75c7ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:53.358137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-122ca2e6-3cda-4171-b4c6-3425c75c7ead None None] MFA Rules not processed for user `b7495e57630d4978a2a5c1681b8578c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:53.359361 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-122ca2e6-3cda-4171-b4c6-3425c75c7ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:53.426685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 476/931] 10.222.0.70 () {58 vars in 1062 bytes} [Wed Aug 24 09:56:53 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:56:53.436228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac0753-07da-4b52-a4ea-fbdc635ed43c None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:53.449553 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac0753-07da-4b52-a4ea-fbdc635ed43c None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:53.453277 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f144ca9-2c6d-42e0-b3c4-e25d98f963b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:53.453897 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f144ca9-2c6d-42e0-b3c4-e25d98f963b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:53.454178 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f144ca9-2c6d-42e0-b3c4-e25d98f963b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:53.454457 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f144ca9-2c6d-42e0-b3c4-e25d98f963b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:53.464430 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f144ca9-2c6d-42e0-b3c4-e25d98f963b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:53.465908 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f144ca9-2c6d-42e0-b3c4-e25d98f963b0 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:53.476630 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 456/932] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:56.093020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dddb4-e007-4447-8cf6-79f056733b0a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:56.093942 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dddb4-e007-4447-8cf6-79f056733b0a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:56.093942 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dddb4-e007-4447-8cf6-79f056733b0a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:56.095216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 477/933] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:56:56.101347 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f795a12-4f1e-49ef-9e42-e596642618a4 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:56.102601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f795a12-4f1e-49ef-9e42-e596642618a4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:56.102601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f795a12-4f1e-49ef-9e42-e596642618a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:56.124011 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3f795a12-4f1e-49ef-9e42-e596642618a4 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:56.125307 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3f795a12-4f1e-49ef-9e42-e596642618a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:56.133483 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 457/934] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:56:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:56:56.493989 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa07b-ca3b-4626-ae8e-ef700efc7481 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:56.494434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa07b-ca3b-4626-ae8e-ef700efc7481 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:56.494890 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa07b-ca3b-4626-ae8e-ef700efc7481 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:56.496865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 478/935] 10.222.0.70 () {54 vars in 965 bytes} [Wed Aug 24 09:56:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:56:56.503910 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c745-8086-4454-9b31-c1c0f630e229 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:56.504202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c745-8086-4454-9b31-c1c0f630e229 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:56.504485 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c745-8086-4454-9b31-c1c0f630e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:56.526933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ab04c745-8086-4454-9b31-c1c0f630e229 None None] MFA Rules not processed for user `b7495e57630d4978a2a5c1681b8578c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:56.528202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ab04c745-8086-4454-9b31-c1c0f630e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:56.536064 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 458/936] 10.222.0.70 () {58 vars in 1062 bytes} [Wed Aug 24 09:56:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:56:56.546307 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaa07b-ca3b-4626-ae8e-ef700efc7481 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:56.560506 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaa07b-ca3b-4626-ae8e-ef700efc7481 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:56.564426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9e35-93b7-480a-8bd3-e96d0563ca83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:56.565060 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9e35-93b7-480a-8bd3-e96d0563ca83 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:56.565333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9e35-93b7-480a-8bd3-e96d0563ca83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:56.565608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9e35-93b7-480a-8bd3-e96d0563ca83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:56.575944 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e9e35-93b7-480a-8bd3-e96d0563ca83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:56.577364 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e9e35-93b7-480a-8bd3-e96d0563ca83 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:56.588897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 479/937] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:59.787776 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99587fc-ea55-44fd-a6ee-0fd8f17bab7e None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:59.788350 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99587fc-ea55-44fd-a6ee-0fd8f17bab7e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:59.788350 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99587fc-ea55-44fd-a6ee-0fd8f17bab7e None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:59.789865 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 459/938] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:56:59.795507 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e7e1-a709-44f6-8598-2e7d3efca3fc None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:59.796006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e7e1-a709-44f6-8598-2e7d3efca3fc None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:59.796103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e7e1-a709-44f6-8598-2e7d3efca3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:59.839962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-8d94e7e1-a709-44f6-8598-2e7d3efca3fc None None] MFA Rules not processed for user `f4818dd43b034eaeb350bdeba58b6cea`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:59.841203 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-8d94e7e1-a709-44f6-8598-2e7d3efca3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:59.917424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:59.962016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 480/939] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:56:59 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:00.311586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99587fc-ea55-44fd-a6ee-0fd8f17bab7e None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:00.329754 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99587fc-ea55-44fd-a6ee-0fd8f17bab7e None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:00.333731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634acf-3f07-46fd-b7ab-01f57d8e445e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:00.334453 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634acf-3f07-46fd-b7ab-01f57d8e445e service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:00.334796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634acf-3f07-46fd-b7ab-01f57d8e445e service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:00.335132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634acf-3f07-46fd-b7ab-01f57d8e445e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:00.348090 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f634acf-3f07-46fd-b7ab-01f57d8e445e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:00.349641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f634acf-3f07-46fd-b7ab-01f57d8e445e service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:00.361125 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 460/940] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:00 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:03.725105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae99f6-6554-4995-bcfd-3633ae0a7636 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:03.725717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae99f6-6554-4995-bcfd-3633ae0a7636 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:03.725717 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae99f6-6554-4995-bcfd-3633ae0a7636 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:03.727772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 481/941] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:03.734148 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b286-4c52-460a-a6a6-c48b994480ff None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:03.734688 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b286-4c52-460a-a6a6-c48b994480ff None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:03.734688 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16b286-4c52-460a-a6a6-c48b994480ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:03.754477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ed16b286-4c52-460a-a6a6-c48b994480ff None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:03.755697 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ed16b286-4c52-460a-a6a6-c48b994480ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:03.834106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 461/942] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:03 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:04.187153 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae99f6-6554-4995-bcfd-3633ae0a7636 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:04.199444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae99f6-6554-4995-bcfd-3633ae0a7636 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:04.203186 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99a8b3-45d4-42af-8d6f-3a8f3beaf241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:04.203871 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a8b3-45d4-42af-8d6f-3a8f3beaf241 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:04.204194 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a8b3-45d4-42af-8d6f-3a8f3beaf241 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:04.204512 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a8b3-45d4-42af-8d6f-3a8f3beaf241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:04.214966 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99a8b3-45d4-42af-8d6f-3a8f3beaf241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:04.216402 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99a8b3-45d4-42af-8d6f-3a8f3beaf241 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:04.226772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 482/943] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:04 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:07.287016 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030af0-c08e-4517-83d7-50622092167d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:07.287535 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030af0-c08e-4517-83d7-50622092167d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:07.287535 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a030af0-c08e-4517-83d7-50622092167d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:07.288958 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 462/944] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:07.294886 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba63ecd-2e23-4760-8cca-a711f1e4334a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:07.295443 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba63ecd-2e23-4760-8cca-a711f1e4334a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:07.295443 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba63ecd-2e23-4760-8cca-a711f1e4334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:07.316730 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-8ba63ecd-2e23-4760-8cca-a711f1e4334a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:07.317973 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-8ba63ecd-2e23-4760-8cca-a711f1e4334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:07.327322 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 483/945] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:07.669539 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a030af0-c08e-4517-83d7-50622092167d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:07.684459 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a030af0-c08e-4517-83d7-50622092167d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:07.688168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b311d-9d97-4dc6-a09c-379d6089b353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:07.688831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b311d-9d97-4dc6-a09c-379d6089b353 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:07.689111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b311d-9d97-4dc6-a09c-379d6089b353 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:07.689384 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b311d-9d97-4dc6-a09c-379d6089b353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:07.699949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b311d-9d97-4dc6-a09c-379d6089b353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:07.701444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b311d-9d97-4dc6-a09c-379d6089b353 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:07.714418 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 463/946] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:10.020753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede357f-eb25-441a-9551-8b643396727f None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:10.021503 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede357f-eb25-441a-9551-8b643396727f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:10.021503 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede357f-eb25-441a-9551-8b643396727f None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:10.022627 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 484/947] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:10.028855 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb1206-060b-4d5b-b93c-2a9154b1dd07 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:10.029401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb1206-060b-4d5b-b93c-2a9154b1dd07 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:10.029401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb1206-060b-4d5b-b93c-2a9154b1dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:10.051391 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-a1bb1206-060b-4d5b-b93c-2a9154b1dd07 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:10.052603 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a1bb1206-060b-4d5b-b93c-2a9154b1dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:10.062214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 464/948] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:10.400292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede357f-eb25-441a-9551-8b643396727f None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:10.412065 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede357f-eb25-441a-9551-8b643396727f None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:10.417115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4fb1-cc7f-49c1-adca-793c585ded83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:10.417830 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4fb1-cc7f-49c1-adca-793c585ded83 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:10.418107 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4fb1-cc7f-49c1-adca-793c585ded83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:10.418435 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4fb1-cc7f-49c1-adca-793c585ded83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:10.428289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4fb1-cc7f-49c1-adca-793c585ded83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:10.430315 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4fb1-cc7f-49c1-adca-793c585ded83 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:10.440824 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 485/949] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:12.781132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81b32-c310-482a-bd68-6f0ed60a5463 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:12.781726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81b32-c310-482a-bd68-6f0ed60a5463 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:12.781726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b81b32-c310-482a-bd68-6f0ed60a5463 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:12.783018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 465/950] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:12.788850 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834e70-e7ff-46ea-8ed4-72c0026fd582 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:12.789617 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834e70-e7ff-46ea-8ed4-72c0026fd582 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:12.789801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834e70-e7ff-46ea-8ed4-72c0026fd582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:12.810764 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-27834e70-e7ff-46ea-8ed4-72c0026fd582 None None] MFA Rules not processed for user `f4818dd43b034eaeb350bdeba58b6cea`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:12.811969 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-27834e70-e7ff-46ea-8ed4-72c0026fd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:12.821170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 486/951] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:12 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:13.176474 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b81b32-c310-482a-bd68-6f0ed60a5463 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:13.188157 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b81b32-c310-482a-bd68-6f0ed60a5463 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:13.191836 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9875889-fa84-485f-82d4-f74421b80db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:13.192450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9875889-fa84-485f-82d4-f74421b80db0 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:13.192755 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9875889-fa84-485f-82d4-f74421b80db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:13.193024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9875889-fa84-485f-82d4-f74421b80db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:13.203367 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9875889-fa84-485f-82d4-f74421b80db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:13.204938 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9875889-fa84-485f-82d4-f74421b80db0 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:13.215628 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 466/952] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:13 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:15.855290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7195cfb-4c07-4266-b5ea-8ebf02afcb27 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:15.856093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7195cfb-4c07-4266-b5ea-8ebf02afcb27 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:15.856093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7195cfb-4c07-4266-b5ea-8ebf02afcb27 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:15.857207 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 487/953] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:15.863005 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e0ac-66a9-4f3d-bd55-733768500b21 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:15.863509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e0ac-66a9-4f3d-bd55-733768500b21 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:15.863693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686e0ac-66a9-4f3d-bd55-733768500b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:15.884276 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-7686e0ac-66a9-4f3d-bd55-733768500b21 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:15.885533 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-7686e0ac-66a9-4f3d-bd55-733768500b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:15.893589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 467/954] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:57:16.233334 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7195cfb-4c07-4266-b5ea-8ebf02afcb27 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:16.250181 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7195cfb-4c07-4266-b5ea-8ebf02afcb27 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:16.255293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a91eb5-5eb2-4a3f-b3df-1015fc2a01c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:16.256014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a91eb5-5eb2-4a3f-b3df-1015fc2a01c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:16.256391 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a91eb5-5eb2-4a3f-b3df-1015fc2a01c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:16.256821 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a91eb5-5eb2-4a3f-b3df-1015fc2a01c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:16.267830 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a91eb5-5eb2-4a3f-b3df-1015fc2a01c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:16.269907 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a91eb5-5eb2-4a3f-b3df-1015fc2a01c3 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:16.284412 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 488/955] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:18.595666 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d0e4-1b2b-4e94-9c14-80d0d54870d9 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:18.596122 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d0e4-1b2b-4e94-9c14-80d0d54870d9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:18.597049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d0e4-1b2b-4e94-9c14-80d0d54870d9 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:18.598842 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 468/956] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:18.604264 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e3c6-95a4-4d00-bc9d-cdc27d7d6a42 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:18.605173 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e3c6-95a4-4d00-bc9d-cdc27d7d6a42 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:18.605441 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e3c6-95a4-4d00-bc9d-cdc27d7d6a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:18.640144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e112e3c6-95a4-4d00-bc9d-cdc27d7d6a42 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:18.641835 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e112e3c6-95a4-4d00-bc9d-cdc27d7d6a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:18.651112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 489/957] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:18.993170 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d0e4-1b2b-4e94-9c14-80d0d54870d9 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:19.004317 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d0e4-1b2b-4e94-9c14-80d0d54870d9 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:19.008956 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b63cd-dc7f-4a42-9a40-343d4610396d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:19.009669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b63cd-dc7f-4a42-9a40-343d4610396d service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:19.010018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b63cd-dc7f-4a42-9a40-343d4610396d service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:19.010354 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b63cd-dc7f-4a42-9a40-343d4610396d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:19.022702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b63cd-dc7f-4a42-9a40-343d4610396d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:19.024242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b63cd-dc7f-4a42-9a40-343d4610396d service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:19.035185 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 469/958] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:21.799192 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aba0c-066e-4399-92ca-d6832e453a5d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:21.799705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aba0c-066e-4399-92ca-d6832e453a5d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:21.799705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aba0c-066e-4399-92ca-d6832e453a5d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:21.801016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 490/959] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:21.808853 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a498b7b-5e67-4145-b40b-10ca0b235d48 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:21.809356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a498b7b-5e67-4145-b40b-10ca0b235d48 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:21.809477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a498b7b-5e67-4145-b40b-10ca0b235d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:21.816882 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=74 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:21.830221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-5a498b7b-5e67-4145-b40b-10ca0b235d48 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:21.831450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-5a498b7b-5e67-4145-b40b-10ca0b235d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:21.840033 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 470/960] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:21 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:22.185180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aba0c-066e-4399-92ca-d6832e453a5d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:22.196624 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aba0c-066e-4399-92ca-d6832e453a5d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:22.200188 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce280-de3d-4e9f-aeab-71a93c3b3b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:22.200822 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce280-de3d-4e9f-aeab-71a93c3b3b83 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:22.201106 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce280-de3d-4e9f-aeab-71a93c3b3b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:22.201380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce280-de3d-4e9f-aeab-71a93c3b3b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:22.211988 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ce280-de3d-4e9f-aeab-71a93c3b3b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:22.214606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ce280-de3d-4e9f-aeab-71a93c3b3b83 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:22.225245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 491/961] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:22 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:26.724842 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762dca3-6940-42a5-80be-da682809beb4 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:26.725930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762dca3-6940-42a5-80be-da682809beb4 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:26.725930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762dca3-6940-42a5-80be-da682809beb4 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:26.727821 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 471/962] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:57:26.734110 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3045-7474-4216-95ad-ab3a4b4e0430 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:26.734946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3045-7474-4216-95ad-ab3a4b4e0430 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:26.734946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3045-7474-4216-95ad-ab3a4b4e0430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:26.755904 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-b5fc3045-7474-4216-95ad-ab3a4b4e0430 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:26.757163 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-b5fc3045-7474-4216-95ad-ab3a4b4e0430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:26.765402 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 492/963] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:27.117726 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762dca3-6940-42a5-80be-da682809beb4 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:27.131372 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762dca3-6940-42a5-80be-da682809beb4 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:27.135118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30d4b8-8e5b-43ea-a5ac-af98eb9c813d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:27.135722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30d4b8-8e5b-43ea-a5ac-af98eb9c813d service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:27.136003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30d4b8-8e5b-43ea-a5ac-af98eb9c813d service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:27.136277 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30d4b8-8e5b-43ea-a5ac-af98eb9c813d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:27.146665 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30d4b8-8e5b-43ea-a5ac-af98eb9c813d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:27.148613 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30d4b8-8e5b-43ea-a5ac-af98eb9c813d service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:27.159147 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 472/964] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:30.166014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee393-8f77-4473-9821-70d264fafbfd None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:30.166709 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee393-8f77-4473-9821-70d264fafbfd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:30.166709 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee393-8f77-4473-9821-70d264fafbfd None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:30.167936 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 493/965] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:30.174028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706dab-b983-45aa-89b8-70a9b1f62bae None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:30.174593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706dab-b983-45aa-89b8-70a9b1f62bae None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:30.174593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd706dab-b983-45aa-89b8-70a9b1f62bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:30.201136 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-dd706dab-b983-45aa-89b8-70a9b1f62bae None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:30.203047 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-dd706dab-b983-45aa-89b8-70a9b1f62bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:30.215788 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 473/966] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:30 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:30.560627 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fee393-8f77-4473-9821-70d264fafbfd None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:30.568723 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=48 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:30.577944 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fee393-8f77-4473-9821-70d264fafbfd None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:30.583054 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac92a0-cec1-4c53-8dcc-1cb0a6e2fa68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:30.583891 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac92a0-cec1-4c53-8dcc-1cb0a6e2fa68 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:30.584171 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac92a0-cec1-4c53-8dcc-1cb0a6e2fa68 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:30.584568 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac92a0-cec1-4c53-8dcc-1cb0a6e2fa68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:30.598800 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac92a0-cec1-4c53-8dcc-1cb0a6e2fa68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:30.602355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac92a0-cec1-4c53-8dcc-1cb0a6e2fa68 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:30.616649 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 494/967] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:30 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:35.409504 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b699c-43d5-4328-8e22-414655a2ee63 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:35.410081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b699c-43d5-4328-8e22-414655a2ee63 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:35.410081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b699c-43d5-4328-8e22-414655a2ee63 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:35.411291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 474/968] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:35.416600 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fb240-0c49-4c3e-826c-a2a2a3946f30 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:35.417097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fb240-0c49-4c3e-826c-a2a2a3946f30 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:35.417205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fb240-0c49-4c3e-826c-a2a2a3946f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:35.436630 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-4a2fb240-0c49-4c3e-826c-a2a2a3946f30 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:35.437837 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-4a2fb240-0c49-4c3e-826c-a2a2a3946f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:35.446318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 495/969] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:35.785319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b699c-43d5-4328-8e22-414655a2ee63 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:35.797715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b699c-43d5-4328-8e22-414655a2ee63 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:35.801277 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c2b0a-05a9-49d7-916d-c91a85670aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:35.801875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2b0a-05a9-49d7-916d-c91a85670aec service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:35.802148 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2b0a-05a9-49d7-916d-c91a85670aec service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:35.802417 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c2b0a-05a9-49d7-916d-c91a85670aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:35.813049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c2b0a-05a9-49d7-916d-c91a85670aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:35.814869 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c2b0a-05a9-49d7-916d-c91a85670aec service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:35.826351 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 475/970] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:42.199139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302526d-1001-4c6d-85b9-dfaa1aafef9d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:42.199679 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302526d-1001-4c6d-85b9-dfaa1aafef9d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:42.199679 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302526d-1001-4c6d-85b9-dfaa1aafef9d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:42.201066 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 496/971] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 09:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:42.216706 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaa799-4ef0-4457-ac40-1a2d09e1f01f None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:42.216706 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaa799-4ef0-4457-ac40-1a2d09e1f01f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:42.216706 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaa799-4ef0-4457-ac40-1a2d09e1f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:42.278602 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-83aaa799-4ef0-4457-ac40-1a2d09e1f01f None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:42.283124 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-83aaa799-4ef0-4457-ac40-1a2d09e1f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:42.388488 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 476/972] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 09:57:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:45.431725 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=8 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:47.443590 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d938c86-ec01-4b3b-91e2-217654b22a30 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:47.444232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d938c86-ec01-4b3b-91e2-217654b22a30 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:47.444232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d938c86-ec01-4b3b-91e2-217654b22a30 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:47.445947 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 497/973] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 09:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:47.451136 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567b669-dd8e-43c2-a065-55922d4e2136 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:47.451587 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567b669-dd8e-43c2-a065-55922d4e2136 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:47.451896 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567b669-dd8e-43c2-a065-55922d4e2136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:47.474139 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c567b669-dd8e-43c2-a065-55922d4e2136 None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:47.476076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c567b669-dd8e-43c2-a065-55922d4e2136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:47.485196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 477/974] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 09:57:47 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:49.363234 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148f957-b543-488d-b3da-4e0b3985089a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:49.363797 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148f957-b543-488d-b3da-4e0b3985089a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:49.363797 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148f957-b543-488d-b3da-4e0b3985089a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:49.365187 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 498/975] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 09:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:49.370629 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbefc64-033d-44db-976a-bc7ca12b971a None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:49.371109 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbefc64-033d-44db-976a-bc7ca12b971a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:49.371109 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbefc64-033d-44db-976a-bc7ca12b971a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:49.392315 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-8dbefc64-033d-44db-976a-bc7ca12b971a None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:49.394214 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-8dbefc64-033d-44db-976a-bc7ca12b971a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:49.404731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 478/976] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 09:57:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:53.308070 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df6425-9b46-4755-9740-2dc4036d5d86 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:53.308603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df6425-9b46-4755-9740-2dc4036d5d86 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:53.311272 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df6425-9b46-4755-9740-2dc4036d5d86 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:53.314043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 499/977] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:53.323076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850db2a-7a20-4106-a070-fa371468cb7e None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:53.323601 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850db2a-7a20-4106-a070-fa371468cb7e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:53.323715 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850db2a-7a20-4106-a070-fa371468cb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:53.331981 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=63 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:53.353829 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-0850db2a-7a20-4106-a070-fa371468cb7e None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:53.355748 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-0850db2a-7a20-4106-a070-fa371468cb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:53.369578 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 479/978] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:53.766724 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68faa-aa40-4a70-90e1-90e21e4a8450 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:53.767379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68faa-aa40-4a70-90e1-90e21e4a8450 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:53.767874 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca68faa-aa40-4a70-90e1-90e21e4a8450 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:53.770405 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 500/979] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 24 09:57:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:57:53.781098 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731a52b-5b5d-4a4f-bfbe-c6cf3d7d3019 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:53.781772 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731a52b-5b5d-4a4f-bfbe-c6cf3d7d3019 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:53.782429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731a52b-5b5d-4a4f-bfbe-c6cf3d7d3019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:53.840763 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-4731a52b-5b5d-4a4f-bfbe-c6cf3d7d3019 None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:53.843305 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-4731a52b-5b5d-4a4f-bfbe-c6cf3d7d3019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:53.933894 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 480/980] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 24 09:57:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:57:53.941847 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca68faa-aa40-4a70-90e1-90e21e4a8450 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:53.956243 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca68faa-aa40-4a70-90e1-90e21e4a8450 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:53.962121 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79115464-0361-4a18-8887-57dd56f68b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:53.963108 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79115464-0361-4a18-8887-57dd56f68b2d service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:53.963658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79115464-0361-4a18-8887-57dd56f68b2d service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:53.964154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79115464-0361-4a18-8887-57dd56f68b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:53.975057 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79115464-0361-4a18-8887-57dd56f68b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:53.977456 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79115464-0361-4a18-8887-57dd56f68b2d service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:53.989777 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 501/981] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:57:56.474794 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19127aec-5470-4d20-8f09-2ae2283ad1b8 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:56.475565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19127aec-5470-4d20-8f09-2ae2283ad1b8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:56.475565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19127aec-5470-4d20-8f09-2ae2283ad1b8 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:56.476919 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 481/982] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:56.482390 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1b47-30c6-4475-9933-bb5e9dfff047 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:56.483333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1b47-30c6-4475-9933-bb5e9dfff047 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:56.483880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d1b47-30c6-4475-9933-bb5e9dfff047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:56.507252 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-435d1b47-30c6-4475-9933-bb5e9dfff047 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:56.508837 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-435d1b47-30c6-4475-9933-bb5e9dfff047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:56.517052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 502/983] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:56.870749 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19127aec-5470-4d20-8f09-2ae2283ad1b8 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:56.885179 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19127aec-5470-4d20-8f09-2ae2283ad1b8 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:56.890274 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d47502-98c9-4498-865f-2ece987f4217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:56.890890 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d47502-98c9-4498-865f-2ece987f4217 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:56.891177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d47502-98c9-4498-865f-2ece987f4217 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:56.891450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d47502-98c9-4498-865f-2ece987f4217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:56.902923 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d47502-98c9-4498-865f-2ece987f4217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:56.904547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d47502-98c9-4498-865f-2ece987f4217 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:56.917133 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 482/984] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:57:59.514836 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9acef3-5946-4ab1-8fcd-8496c3027731 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:59.515352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9acef3-5946-4ab1-8fcd-8496c3027731 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:59.515352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9acef3-5946-4ab1-8fcd-8496c3027731 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:59.516705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 503/985] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:59.522189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76c1a-4be9-48e9-8712-1cc91c4eb687 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:59.522588 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76c1a-4be9-48e9-8712-1cc91c4eb687 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:59.522748 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76c1a-4be9-48e9-8712-1cc91c4eb687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:59.543339 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-a6b76c1a-4be9-48e9-8712-1cc91c4eb687 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:59.544540 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a6b76c1a-4be9-48e9-8712-1cc91c4eb687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:59.553168 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 483/986] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:57:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:59.910420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f341-bfbe-4699-a0cd-712d8237ee69 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:59.910706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f341-bfbe-4699-a0cd-712d8237ee69 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:59.913935 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f341-bfbe-4699-a0cd-712d8237ee69 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:59.914984 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 504/987] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 24 09:57:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:57:59.921983 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2762f9-d9e8-46c9-873e-a25644baff92 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:59.922546 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2762f9-d9e8-46c9-873e-a25644baff92 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:59.923007 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2762f9-d9e8-46c9-873e-a25644baff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:59.947697 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-7b2762f9-d9e8-46c9-873e-a25644baff92 None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:59.949079 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-7b2762f9-d9e8-46c9-873e-a25644baff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:59.958267 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 484/988] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 24 09:57:59 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:57:59.969202 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1f341-bfbe-4699-a0cd-712d8237ee69 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:59.983745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1f341-bfbe-4699-a0cd-712d8237ee69 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:59.989146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7f15b-d48b-46a0-b0bd-741bdda6d719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:59.990406 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f15b-d48b-46a0-b0bd-741bdda6d719 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:59.990904 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f15b-d48b-46a0-b0bd-741bdda6d719 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:59.991392 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f15b-d48b-46a0-b0bd-741bdda6d719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:00.001931 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7f15b-d48b-46a0-b0bd-741bdda6d719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:00.003673 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7f15b-d48b-46a0-b0bd-741bdda6d719 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:00.015102 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 505/989] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:02.348717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9b58-46fa-4faa-9ebd-c36a61aaaa2b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:02.349799 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9b58-46fa-4faa-9ebd-c36a61aaaa2b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:02.350291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9b58-46fa-4faa-9ebd-c36a61aaaa2b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:02.356149 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 485/990] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:02.357541 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7cdc-0a80-4389-b794-cfda8525de89 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:02.358013 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7cdc-0a80-4389-b794-cfda8525de89 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:02.358097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7cdc-0a80-4389-b794-cfda8525de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:02.384569 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-939b7cdc-0a80-4389-b794-cfda8525de89 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:02.387051 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-939b7cdc-0a80-4389-b794-cfda8525de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:02.409110 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 506/991] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:02.798336 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9b58-46fa-4faa-9ebd-c36a61aaaa2b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:02.814604 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9b58-46fa-4faa-9ebd-c36a61aaaa2b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:02.820875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbe882-d706-4ffe-8981-8caad9e46160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:02.821880 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe882-d706-4ffe-8981-8caad9e46160 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:02.822405 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe882-d706-4ffe-8981-8caad9e46160 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:02.822898 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe882-d706-4ffe-8981-8caad9e46160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:02.833123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbe882-d706-4ffe-8981-8caad9e46160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:02.835475 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbe882-d706-4ffe-8981-8caad9e46160 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:02.860699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 486/992] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:04.062850 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b51ed-60da-415a-a96d-5b02b76f1d22 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:04.063290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b51ed-60da-415a-a96d-5b02b76f1d22 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:04.063290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b51ed-60da-415a-a96d-5b02b76f1d22 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:04.069233 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 507/993] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:04.070650 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6e6a1-6856-46ec-a2d7-dcaeac297ae6 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:04.071691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6e6a1-6856-46ec-a2d7-dcaeac297ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:04.072117 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6e6a1-6856-46ec-a2d7-dcaeac297ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:04.102790 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-50e6e6a1-6856-46ec-a2d7-dcaeac297ae6 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:04.104649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-50e6e6a1-6856-46ec-a2d7-dcaeac297ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:04.117282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 487/994] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:04.730245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ededf-b835-4d5a-ad4c-1de1a83eff63 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:04.730530 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ededf-b835-4d5a-ad4c-1de1a83eff63 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:04.731084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ededf-b835-4d5a-ad4c-1de1a83eff63 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:04.732542 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 508/995] 10.222.0.70 () {54 vars in 964 bytes} [Wed Aug 24 09:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:04.737423 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553281c-eab3-4a5f-80ea-8502fe98fa1c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:04.737714 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553281c-eab3-4a5f-80ea-8502fe98fa1c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:04.737994 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553281c-eab3-4a5f-80ea-8502fe98fa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:04.779036 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-e553281c-eab3-4a5f-80ea-8502fe98fa1c None None] MFA Rules not processed for user `7712bef2122745c3b05aad9e4dff7c12`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:04.780290 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-e553281c-eab3-4a5f-80ea-8502fe98fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:04.852002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 488/996] 10.222.0.70 () {58 vars in 1061 bytes} [Wed Aug 24 09:58:04 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:04.860304 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ededf-b835-4d5a-ad4c-1de1a83eff63 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:04.872233 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ededf-b835-4d5a-ad4c-1de1a83eff63 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:04.875749 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b831379-6cf3-4200-b50f-c58b1bf83a1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7712bef2122745c3b05aad9e4dff7c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:04.876353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831379-6cf3-4200-b50f-c58b1bf83a1c service cinder] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:04.876633 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831379-6cf3-4200-b50f-c58b1bf83a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:04.876941 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831379-6cf3-4200-b50f-c58b1bf83a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:04.888247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b831379-6cf3-4200-b50f-c58b1bf83a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:04.890030 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b831379-6cf3-4200-b50f-c58b1bf83a1c service cinder] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:04.911665 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 509/997] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:58:05.280170 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f14f-7584-4c82-9e85-2c0ff8d05c83 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:05.280733 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f14f-7584-4c82-9e85-2c0ff8d05c83 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:05.281027 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f14f-7584-4c82-9e85-2c0ff8d05c83 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:05.282316 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 489/998] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:05.287829 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bdf28-02a3-4f85-a4e3-d5480a814755 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:05.288400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bdf28-02a3-4f85-a4e3-d5480a814755 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:05.288400 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bdf28-02a3-4f85-a4e3-d5480a814755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:05.308318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e20bdf28-02a3-4f85-a4e3-d5480a814755 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:05.309596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e20bdf28-02a3-4f85-a4e3-d5480a814755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:05.318515 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 510/999] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:05.675397 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70f14f-7584-4c82-9e85-2c0ff8d05c83 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:05.701824 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70f14f-7584-4c82-9e85-2c0ff8d05c83 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:05.708577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa615c-6655-4399-b036-130a93a0c26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:05.710896 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa615c-6655-4399-b036-130a93a0c26d service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:05.711944 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa615c-6655-4399-b036-130a93a0c26d service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:05.712778 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa615c-6655-4399-b036-130a93a0c26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:05.729936 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa615c-6655-4399-b036-130a93a0c26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:05.732408 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa615c-6655-4399-b036-130a93a0c26d service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:05.739534 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:05.761365 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 490/1000] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:08.070205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd56daa-6bc2-4247-bc17-de71b6304ea2 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:08.070722 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd56daa-6bc2-4247-bc17-de71b6304ea2 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:08.070814 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd56daa-6bc2-4247-bc17-de71b6304ea2 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:08.072061 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 511/1001] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:08.077692 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa375e76-7671-46e7-ab1f-c1c9318dfaf7 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:08.078162 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa375e76-7671-46e7-ab1f-c1c9318dfaf7 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:08.078261 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa375e76-7671-46e7-ab1f-c1c9318dfaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:08.099067 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-aa375e76-7671-46e7-ab1f-c1c9318dfaf7 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:08.100285 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-aa375e76-7671-46e7-ab1f-c1c9318dfaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:08.108402 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 491/1002] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:08.453571 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd56daa-6bc2-4247-bc17-de71b6304ea2 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:08.467815 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd56daa-6bc2-4247-bc17-de71b6304ea2 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:08.475386 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031529b4-48d3-423a-baae-7ebeb71e352e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:08.475988 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031529b4-48d3-423a-baae-7ebeb71e352e service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:08.476266 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031529b4-48d3-423a-baae-7ebeb71e352e service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:08.476532 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031529b4-48d3-423a-baae-7ebeb71e352e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:08.485932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031529b4-48d3-423a-baae-7ebeb71e352e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:08.487557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031529b4-48d3-423a-baae-7ebeb71e352e service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:08.501451 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 512/1003] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:10.782052 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac794d7-2f43-4554-a713-d9693fc86b72 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:10.782620 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac794d7-2f43-4554-a713-d9693fc86b72 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:10.782833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac794d7-2f43-4554-a713-d9693fc86b72 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:10.784277 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 492/1004] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:10.790893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a6d00-f244-4a3f-b261-5199d539974a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:10.791378 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a6d00-f244-4a3f-b261-5199d539974a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:10.791517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a6d00-f244-4a3f-b261-5199d539974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:10.811951 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-064a6d00-f244-4a3f-b261-5199d539974a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:10.813205 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-064a6d00-f244-4a3f-b261-5199d539974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:10.822130 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 513/1005] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:11.178947 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac794d7-2f43-4554-a713-d9693fc86b72 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:11.193581 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac794d7-2f43-4554-a713-d9693fc86b72 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:11.199200 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d7f70-f146-466b-a665-225e26362ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:11.199805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7f70-f146-466b-a665-225e26362ed9 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:11.200216 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7f70-f146-466b-a665-225e26362ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:11.200510 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7f70-f146-466b-a665-225e26362ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:11.210922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d7f70-f146-466b-a665-225e26362ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:11.212505 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d7f70-f146-466b-a665-225e26362ed9 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:11.223779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 493/1006] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:13.767524 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d3d62-56cc-4229-8228-aacd9fba579a None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:13.768058 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d3d62-56cc-4229-8228-aacd9fba579a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:13.768210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d3d62-56cc-4229-8228-aacd9fba579a None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:13.770003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 514/1007] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:13.777729 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a1a08-83e0-45c8-99b6-729beac5ab6c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:13.778229 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a1a08-83e0-45c8-99b6-729beac5ab6c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:13.778327 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a1a08-83e0-45c8-99b6-729beac5ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:13.800121 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-de0a1a08-83e0-45c8-99b6-729beac5ab6c None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:13.801412 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-de0a1a08-83e0-45c8-99b6-729beac5ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:13.811263 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 494/1008] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:14.272652 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d3d62-56cc-4229-8228-aacd9fba579a None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:14.289464 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d3d62-56cc-4229-8228-aacd9fba579a None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:14.295511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3795d-7006-4ecf-8964-46e7ad005fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:14.296276 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3795d-7006-4ecf-8964-46e7ad005fd8 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:14.296635 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3795d-7006-4ecf-8964-46e7ad005fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:14.297214 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3795d-7006-4ecf-8964-46e7ad005fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:14.308751 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3795d-7006-4ecf-8964-46e7ad005fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:14.310800 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3795d-7006-4ecf-8964-46e7ad005fd8 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:14.323012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 515/1009] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:16.979240 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64441-aa93-4f0b-af87-9e0c90fd6ea8 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:16.980610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64441-aa93-4f0b-af87-9e0c90fd6ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:16.980610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64441-aa93-4f0b-af87-9e0c90fd6ea8 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:16.982318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 495/1010] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:16.988033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ca9ad-36fd-4a05-98f9-f17bca8b9075 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:16.988776 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ca9ad-36fd-4a05-98f9-f17bca8b9075 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:16.988776 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ca9ad-36fd-4a05-98f9-f17bca8b9075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:17.001505 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=43 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:17.009942 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-597ca9ad-36fd-4a05-98f9-f17bca8b9075 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:17.011144 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-597ca9ad-36fd-4a05-98f9-f17bca8b9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:17.022873 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 516/1011] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:17.666485 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc64441-aa93-4f0b-af87-9e0c90fd6ea8 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:17.687251 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc64441-aa93-4f0b-af87-9e0c90fd6ea8 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:17.693444 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dddc96-4d8f-4d3e-8588-8882b19c625c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:17.694301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dddc96-4d8f-4d3e-8588-8882b19c625c service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:17.694688 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dddc96-4d8f-4d3e-8588-8882b19c625c service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:17.695121 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dddc96-4d8f-4d3e-8588-8882b19c625c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:17.707439 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dddc96-4d8f-4d3e-8588-8882b19c625c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:17.709626 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dddc96-4d8f-4d3e-8588-8882b19c625c service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:17.722840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 496/1012] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:20.407221 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46140-195a-4e88-893b-299e61294204 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:20.407937 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46140-195a-4e88-893b-299e61294204 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:20.407937 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46140-195a-4e88-893b-299e61294204 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:20.409111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 517/1013] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:20.414524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99aef8-e81e-4795-a028-fb102366d481 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:20.414996 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99aef8-e81e-4795-a028-fb102366d481 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:20.415106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99aef8-e81e-4795-a028-fb102366d481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:20.434702 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9d99aef8-e81e-4795-a028-fb102366d481 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:20.435892 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9d99aef8-e81e-4795-a028-fb102366d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:20.444484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 497/1014] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:20.787472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46140-195a-4e88-893b-299e61294204 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:20.801136 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46140-195a-4e88-893b-299e61294204 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:20.806796 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e93c99-4a66-435b-b892-5336de64e72e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:20.807401 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93c99-4a66-435b-b892-5336de64e72e service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:20.807686 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93c99-4a66-435b-b892-5336de64e72e service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:20.807962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e93c99-4a66-435b-b892-5336de64e72e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:20.816810 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e93c99-4a66-435b-b892-5336de64e72e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:20.818402 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e93c99-4a66-435b-b892-5336de64e72e service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:20.828127 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 518/1015] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:21.250037 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e0618-6d4d-483b-9826-f6e2aaaef613 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:21.250313 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e0618-6d4d-483b-9826-f6e2aaaef613 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:21.250593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e0618-6d4d-483b-9826-f6e2aaaef613 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:21.251988 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 498/1016] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:21.257653 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f2a0-7e43-4a7e-8658-c237b5bd3899 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:21.257946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f2a0-7e43-4a7e-8658-c237b5bd3899 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:21.258221 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f2a0-7e43-4a7e-8658-c237b5bd3899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:21.278316 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-1488f2a0-7e43-4a7e-8658-c237b5bd3899 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:21.279528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1488f2a0-7e43-4a7e-8658-c237b5bd3899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:21.288244 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 519/1017] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:21.660995 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e5e2-04bb-4df5-b5e4-48bb04de9f41 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:21.661718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e5e2-04bb-4df5-b5e4-48bb04de9f41 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:21.661718 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e5e2-04bb-4df5-b5e4-48bb04de9f41 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:21.662860 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 499/1018] 10.222.0.70 () {54 vars in 967 bytes} [Wed Aug 24 09:58:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:21.668738 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce443-c7ce-4efd-a0f4-9ecf423cd043 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:21.669270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce443-c7ce-4efd-a0f4-9ecf423cd043 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:21.669270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ce443-c7ce-4efd-a0f4-9ecf423cd043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:21.710660 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-446ce443-c7ce-4efd-a0f4-9ecf423cd043 None None] MFA Rules not processed for user `e9039bb844c14a8789c6f30e461f77c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:21.711775 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-446ce443-c7ce-4efd-a0f4-9ecf423cd043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:21.774982 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 520/1019] 10.222.0.70 () {58 vars in 1064 bytes} [Wed Aug 24 09:58:21 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:21.782490 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8e5e2-04bb-4df5-b5e4-48bb04de9f41 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:21.793394 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8e5e2-04bb-4df5-b5e4-48bb04de9f41 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:21.797082 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d07ce-e1a2-4e5c-bd51-23abf76ab4f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9039bb844c14a8789c6f30e461f77c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:21.797490 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d07ce-e1a2-4e5c-bd51-23abf76ab4f1 service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:21.797864 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d07ce-e1a2-4e5c-bd51-23abf76ab4f1 service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:21.798044 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d07ce-e1a2-4e5c-bd51-23abf76ab4f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:21.808135 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d07ce-e1a2-4e5c-bd51-23abf76ab4f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:21.809643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d07ce-e1a2-4e5c-bd51-23abf76ab4f1 service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:21.820218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 500/1020] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:23.079761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141cec-4a9d-4e1e-859e-d6f967b97e7b None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:23.080461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141cec-4a9d-4e1e-859e-d6f967b97e7b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:23.080461 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141cec-4a9d-4e1e-859e-d6f967b97e7b None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:23.081810 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 521/1021] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:23.088282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c167a-0902-4a07-8e25-3d7638dc34e2 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:23.088875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c167a-0902-4a07-8e25-3d7638dc34e2 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:23.088875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c167a-0902-4a07-8e25-3d7638dc34e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:23.109167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-dc4c167a-0902-4a07-8e25-3d7638dc34e2 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:23.110402 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-dc4c167a-0902-4a07-8e25-3d7638dc34e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:23.120252 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 501/1022] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:23.470490 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141cec-4a9d-4e1e-859e-d6f967b97e7b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:23.486296 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141cec-4a9d-4e1e-859e-d6f967b97e7b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:23.493355 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bee09e-cb56-4e6c-b8db-abd85d10cbaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:23.494295 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bee09e-cb56-4e6c-b8db-abd85d10cbaf service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:23.494744 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bee09e-cb56-4e6c-b8db-abd85d10cbaf service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:23.495213 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bee09e-cb56-4e6c-b8db-abd85d10cbaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:23.508318 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bee09e-cb56-4e6c-b8db-abd85d10cbaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:23.513232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bee09e-cb56-4e6c-b8db-abd85d10cbaf service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:23.524718 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 522/1023] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:25.872362 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7633d-1e1e-4873-9e78-db6d056e399d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:25.873451 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7633d-1e1e-4873-9e78-db6d056e399d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:25.873728 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7633d-1e1e-4873-9e78-db6d056e399d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:25.875090 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 502/1024] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:25.881256 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b69ca-4953-425c-a2a9-3876de474b6b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:25.882069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b69ca-4953-425c-a2a9-3876de474b6b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:25.882069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b69ca-4953-425c-a2a9-3876de474b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:25.901753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-833b69ca-4953-425c-a2a9-3876de474b6b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:25.902973 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-833b69ca-4953-425c-a2a9-3876de474b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:25.914922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 523/1025] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:58:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:26.274096 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7633d-1e1e-4873-9e78-db6d056e399d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:26.288086 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7633d-1e1e-4873-9e78-db6d056e399d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:26.293045 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4104e-fd67-4760-9675-31e41adac634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:26.293647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4104e-fd67-4760-9675-31e41adac634 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:26.293924 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4104e-fd67-4760-9675-31e41adac634 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:26.294193 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4104e-fd67-4760-9675-31e41adac634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:26.303520 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4104e-fd67-4760-9675-31e41adac634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:26.305245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4104e-fd67-4760-9675-31e41adac634 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:26.318001 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 503/1026] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:35.896858 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=53 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:36.311204 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=37 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:37.200043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342582b-2595-4e55-8fbc-64747bd8bc01 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:37.200568 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342582b-2595-4e55-8fbc-64747bd8bc01 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:37.200708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342582b-2595-4e55-8fbc-64747bd8bc01 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:37.201985 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 524/1027] 10.222.0.70 () {54 vars in 918 bytes} [Wed Aug 24 09:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:37.207932 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbda9c-eeb8-45f5-8297-0085d8db7ec5 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:37.208278 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbda9c-eeb8-45f5-8297-0085d8db7ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:37.208564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbda9c-eeb8-45f5-8297-0085d8db7ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:37.227955 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-33cbda9c-eeb8-45f5-8297-0085d8db7ec5 None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:37.229645 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-33cbda9c-eeb8-45f5-8297-0085d8db7ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:37.238063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 504/1028] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Aug 24 09:58:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:37.251939 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e31da5-8a2d-4d3e-b78b-bcfbc403d0cd None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:37.252228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e31da5-8a2d-4d3e-b78b-bcfbc403d0cd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:37.252535 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e31da5-8a2d-4d3e-b78b-bcfbc403d0cd None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:37.254374 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 525/1029] 10.222.0.70 () {54 vars in 918 bytes} [Wed Aug 24 09:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:37.259237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc4614-c7b1-4736-9779-f865e5181600 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:37.259523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc4614-c7b1-4736-9779-f865e5181600 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:37.259818 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc4614-c7b1-4736-9779-f865e5181600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:37.279509 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-b3bc4614-c7b1-4736-9779-f865e5181600 None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:37.280747 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b3bc4614-c7b1-4736-9779-f865e5181600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:37.289128 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 505/1030] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Aug 24 09:58:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:40.008268 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48665-bb43-4d3f-8127-6da28bd81872 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:40.008904 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48665-bb43-4d3f-8127-6da28bd81872 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:40.008904 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48665-bb43-4d3f-8127-6da28bd81872 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:40.010168 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 526/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:40.015504 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd6ab-c6e1-4a93-bbb4-af0fa9da4984 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:40.015974 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd6ab-c6e1-4a93-bbb4-af0fa9da4984 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:40.016070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd6ab-c6e1-4a93-bbb4-af0fa9da4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:40.036443 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3b5bd6ab-c6e1-4a93-bbb4-af0fa9da4984 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:40.037674 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3b5bd6ab-c6e1-4a93-bbb4-af0fa9da4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:40.045559 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 506/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:40.395818 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d48665-bb43-4d3f-8127-6da28bd81872 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:40.410046 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d48665-bb43-4d3f-8127-6da28bd81872 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:40.415012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135b722-015e-4cc5-9773-16b645c46b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:40.415613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b722-015e-4cc5-9773-16b645c46b9c service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:40.415894 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b722-015e-4cc5-9773-16b645c46b9c service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:40.416166 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b722-015e-4cc5-9773-16b645c46b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:40.424422 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135b722-015e-4cc5-9773-16b645c46b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:40.426128 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135b722-015e-4cc5-9773-16b645c46b9c service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:40.435345 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 527/1033] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:41.408964 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036457fa-d2ef-4567-bffe-e844e5d8b4c0 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:41.408964 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036457fa-d2ef-4567-bffe-e844e5d8b4c0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:41.408964 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036457fa-d2ef-4567-bffe-e844e5d8b4c0 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:41.408964 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 507/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:58:41.415422 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14049c0-bfad-4b1b-b05f-7960b9eb05f0 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:41.416475 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14049c0-bfad-4b1b-b05f-7960b9eb05f0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:41.416746 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14049c0-bfad-4b1b-b05f-7960b9eb05f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:41.436331 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e14049c0-bfad-4b1b-b05f-7960b9eb05f0 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:41.437574 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e14049c0-bfad-4b1b-b05f-7960b9eb05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:41.445648 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 528/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:41.671150 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036457fa-d2ef-4567-bffe-e844e5d8b4c0 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:41.686326 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036457fa-d2ef-4567-bffe-e844e5d8b4c0 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:41.691787 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e1ff8-219d-4ccf-b95c-5cbfa482690b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:41.692390 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1ff8-219d-4ccf-b95c-5cbfa482690b service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:41.692682 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1ff8-219d-4ccf-b95c-5cbfa482690b service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:41.692982 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1ff8-219d-4ccf-b95c-5cbfa482690b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:41.702119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e1ff8-219d-4ccf-b95c-5cbfa482690b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:41.703722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e1ff8-219d-4ccf-b95c-5cbfa482690b service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:41.714034 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 508/1036] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:42.632134 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8373-26e6-42e6-8eae-a05eb48742af None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:42.632637 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8373-26e6-42e6-8eae-a05eb48742af None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:42.632753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b8373-26e6-42e6-8eae-a05eb48742af None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:42.634047 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 529/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:42.639010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32eea-4a08-43b9-b7f5-2b6223e9ae0f None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:42.639422 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32eea-4a08-43b9-b7f5-2b6223e9ae0f None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:42.639565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32eea-4a08-43b9-b7f5-2b6223e9ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:42.659300 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c6d32eea-4a08-43b9-b7f5-2b6223e9ae0f None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:42.661101 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c6d32eea-4a08-43b9-b7f5-2b6223e9ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:42.668907 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 509/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:42.824410 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8373-26e6-42e6-8eae-a05eb48742af None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:42.837999 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b8373-26e6-42e6-8eae-a05eb48742af None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:42.843073 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36181d71-325c-4aba-84a5-98c13ef3cec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:42.843658 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181d71-325c-4aba-84a5-98c13ef3cec4 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:42.843972 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181d71-325c-4aba-84a5-98c13ef3cec4 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:42.844239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181d71-325c-4aba-84a5-98c13ef3cec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:42.854095 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36181d71-325c-4aba-84a5-98c13ef3cec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:42.855720 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36181d71-325c-4aba-84a5-98c13ef3cec4 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:42.865567 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 530/1039] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:43.742879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5817d-2d4f-417a-9e9f-d5952d1cbafb None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:43.743442 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5817d-2d4f-417a-9e9f-d5952d1cbafb None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:43.743442 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5817d-2d4f-417a-9e9f-d5952d1cbafb None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:43.744833 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 510/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:43.749645 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9293-b41e-4375-a8ca-cdd7fb1fa49f None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:43.750083 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9293-b41e-4375-a8ca-cdd7fb1fa49f None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:43.750180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9293-b41e-4375-a8ca-cdd7fb1fa49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:43.770361 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-782f9293-b41e-4375-a8ca-cdd7fb1fa49f None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:43.771579 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-782f9293-b41e-4375-a8ca-cdd7fb1fa49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:43.779916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 531/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:43.935203 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5817d-2d4f-417a-9e9f-d5952d1cbafb None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:43.950048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5817d-2d4f-417a-9e9f-d5952d1cbafb None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:43.955023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263224f7-ef60-4686-b674-86c2eb8e52ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:43.955623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263224f7-ef60-4686-b674-86c2eb8e52ed service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:43.955911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263224f7-ef60-4686-b674-86c2eb8e52ed service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:43.956188 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263224f7-ef60-4686-b674-86c2eb8e52ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:43.965565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263224f7-ef60-4686-b674-86c2eb8e52ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:43.967158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263224f7-ef60-4686-b674-86c2eb8e52ed service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:43.977080 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 511/1042] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:44.859727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3726e78-19b6-40a6-a842-563c55253ff0 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:44.860293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3726e78-19b6-40a6-a842-563c55253ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:44.860293 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3726e78-19b6-40a6-a842-563c55253ff0 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:44.861648 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 532/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:44.867353 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1784-852c-47f8-babd-a18265dc6a26 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:44.867834 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1784-852c-47f8-babd-a18265dc6a26 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:44.867939 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1784-852c-47f8-babd-a18265dc6a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:44.887346 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-070e1784-852c-47f8-babd-a18265dc6a26 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:44.888478 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-070e1784-852c-47f8-babd-a18265dc6a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:44.896850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 512/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:45.054727 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3726e78-19b6-40a6-a842-563c55253ff0 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:45.068043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3726e78-19b6-40a6-a842-563c55253ff0 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:45.072926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dcf36-71cc-4fd3-8d91-5e263522ce8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:45.073526 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dcf36-71cc-4fd3-8d91-5e263522ce8a service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:45.073802 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dcf36-71cc-4fd3-8d91-5e263522ce8a service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:45.074075 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dcf36-71cc-4fd3-8d91-5e263522ce8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:45.083014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dcf36-71cc-4fd3-8d91-5e263522ce8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:45.084585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dcf36-71cc-4fd3-8d91-5e263522ce8a service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:45.094216 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 533/1045] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:45.916139 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae282a4e-f28d-475a-b854-aceb056dee2e None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:45.916550 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae282a4e-f28d-475a-b854-aceb056dee2e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:45.916719 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae282a4e-f28d-475a-b854-aceb056dee2e None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:45.918076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 513/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:45.922945 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed42b56-e8ea-4cfe-836b-4e1b111fa94e None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:45.923369 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed42b56-e8ea-4cfe-836b-4e1b111fa94e None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:45.923486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed42b56-e8ea-4cfe-836b-4e1b111fa94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:45.943423 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9ed42b56-e8ea-4cfe-836b-4e1b111fa94e None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:45.944608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9ed42b56-e8ea-4cfe-836b-4e1b111fa94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:45.952399 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 534/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:46.108450 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae282a4e-f28d-475a-b854-aceb056dee2e None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:46.122595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae282a4e-f28d-475a-b854-aceb056dee2e None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:46.127644 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5d35b-a77c-4a6f-bde2-e2a3661ff2ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:46.128242 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5d35b-a77c-4a6f-bde2-e2a3661ff2ee service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:46.128519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5d35b-a77c-4a6f-bde2-e2a3661ff2ee service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:46.129428 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5d35b-a77c-4a6f-bde2-e2a3661ff2ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:46.138081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5d35b-a77c-4a6f-bde2-e2a3661ff2ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:46.139654 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5d35b-a77c-4a6f-bde2-e2a3661ff2ee service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:46.149191 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 514/1048] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:46.966529 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53447-7880-41b0-a966-85e8faf377df None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:46.967064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53447-7880-41b0-a966-85e8faf377df None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:46.967064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53447-7880-41b0-a966-85e8faf377df None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:46.968694 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 535/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:46.973685 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b29991-9624-46fa-817e-ee917d7c8017 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:46.974120 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b29991-9624-46fa-817e-ee917d7c8017 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:46.974230 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b29991-9624-46fa-817e-ee917d7c8017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:46.993126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-34b29991-9624-46fa-817e-ee917d7c8017 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:46.994356 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-34b29991-9624-46fa-817e-ee917d7c8017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:47.002121 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 515/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:47.159347 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53447-7880-41b0-a966-85e8faf377df None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:47.173424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53447-7880-41b0-a966-85e8faf377df None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:47.178417 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d395b-83f6-479a-a3bf-b61cd7bcb0d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:47.179011 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d395b-83f6-479a-a3bf-b61cd7bcb0d3 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:47.179287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d395b-83f6-479a-a3bf-b61cd7bcb0d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:47.179556 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d395b-83f6-479a-a3bf-b61cd7bcb0d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:47.188176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d395b-83f6-479a-a3bf-b61cd7bcb0d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:47.189851 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d395b-83f6-479a-a3bf-b61cd7bcb0d3 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:47.200039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 536/1051] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:48.025109 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ecb0-6ee3-428d-b120-664e569af4fa None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:48.025669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ecb0-6ee3-428d-b120-664e569af4fa None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:48.025669 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05ecb0-6ee3-428d-b120-664e569af4fa None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:48.027015 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 516/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:48.032034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8d23a-630b-47e9-991c-1dd37bbe0560 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:48.032498 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8d23a-630b-47e9-991c-1dd37bbe0560 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:48.032596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8d23a-630b-47e9-991c-1dd37bbe0560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:48.053440 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-06c8d23a-630b-47e9-991c-1dd37bbe0560 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:48.054646 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-06c8d23a-630b-47e9-991c-1dd37bbe0560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:48.062443 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 537/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:48.217786 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05ecb0-6ee3-428d-b120-664e569af4fa None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:48.231585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05ecb0-6ee3-428d-b120-664e569af4fa None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:48.236437 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657c155-7cff-44a0-9261-d2841c89efa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:48.237057 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c155-7cff-44a0-9261-d2841c89efa2 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:48.237335 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c155-7cff-44a0-9261-d2841c89efa2 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:48.237604 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c155-7cff-44a0-9261-d2841c89efa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:48.245696 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657c155-7cff-44a0-9261-d2841c89efa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:48.247264 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657c155-7cff-44a0-9261-d2841c89efa2 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:48.256562 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 517/1054] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:49.075985 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6a71-da11-42b0-9fb6-88b30715fcb6 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:49.076544 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6a71-da11-42b0-9fb6-88b30715fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:49.076544 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e6a71-da11-42b0-9fb6-88b30715fcb6 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:49.077925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 538/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:49.083017 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e423cc-c999-457b-988e-c862751a775b None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:49.083461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e423cc-c999-457b-988e-c862751a775b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:49.083570 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e423cc-c999-457b-988e-c862751a775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:49.103100 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-98e423cc-c999-457b-988e-c862751a775b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:49.104316 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-98e423cc-c999-457b-988e-c862751a775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:49.112224 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 518/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:49.268497 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e6a71-da11-42b0-9fb6-88b30715fcb6 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:49.282396 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e6a71-da11-42b0-9fb6-88b30715fcb6 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:49.288119 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f233a-e8c9-4288-abb1-d123f25fa1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:49.288761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f233a-e8c9-4288-abb1-d123f25fa1cf service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:49.289041 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f233a-e8c9-4288-abb1-d123f25fa1cf service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:49.289309 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f233a-e8c9-4288-abb1-d123f25fa1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:49.299421 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f233a-e8c9-4288-abb1-d123f25fa1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:49.301702 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f233a-e8c9-4288-abb1-d123f25fa1cf service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:49.311170 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 539/1057] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:51.406788 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff6f3b-e2f6-4b0d-b842-45fed64b8803 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:51.407360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff6f3b-e2f6-4b0d-b842-45fed64b8803 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:51.407360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff6f3b-e2f6-4b0d-b842-45fed64b8803 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:51.408733 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 519/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:51.416879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5467-32ce-4e3f-aa63-92a9a207ced0 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:51.417525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5467-32ce-4e3f-aa63-92a9a207ced0 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:51.417525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5467-32ce-4e3f-aa63-92a9a207ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:51.436986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-636f5467-32ce-4e3f-aa63-92a9a207ced0 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:51.438197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-636f5467-32ce-4e3f-aa63-92a9a207ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:51.446839 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 540/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:51.787554 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff6f3b-e2f6-4b0d-b842-45fed64b8803 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:51.804359 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff6f3b-e2f6-4b0d-b842-45fed64b8803 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:51.810130 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640e886-07e4-4122-b142-145aa35fb157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:51.811123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e886-07e4-4122-b142-145aa35fb157 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:51.811629 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e886-07e4-4122-b142-145aa35fb157 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:51.812077 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e886-07e4-4122-b142-145aa35fb157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:51.828015 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640e886-07e4-4122-b142-145aa35fb157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:51.830736 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640e886-07e4-4122-b142-145aa35fb157 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:51.847863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 520/1060] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:54.206596 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950a7b-f2a5-448b-a1e5-999ff73a8bac None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:54.207143 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950a7b-f2a5-448b-a1e5-999ff73a8bac None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:54.207143 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950a7b-f2a5-448b-a1e5-999ff73a8bac None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:54.208389 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 541/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:54.213845 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5d7b-c6e5-4d1d-ac57-5191aa1d00e1 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:54.214281 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5d7b-c6e5-4d1d-ac57-5191aa1d00e1 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:54.214401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5d7b-c6e5-4d1d-ac57-5191aa1d00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:54.233604 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-97cf5d7b-c6e5-4d1d-ac57-5191aa1d00e1 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:54.234812 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-97cf5d7b-c6e5-4d1d-ac57-5191aa1d00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:54.243564 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 521/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:54.583224 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d950a7b-f2a5-448b-a1e5-999ff73a8bac None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:54.594147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d950a7b-f2a5-448b-a1e5-999ff73a8bac None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:54.598424 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00e428-e32f-4eeb-9c32-86aa8faa7b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:54.599022 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e428-e32f-4eeb-9c32-86aa8faa7b19 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:54.599301 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e428-e32f-4eeb-9c32-86aa8faa7b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:54.599570 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e428-e32f-4eeb-9c32-86aa8faa7b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:54.608885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e428-e32f-4eeb-9c32-86aa8faa7b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:54.610304 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e428-e32f-4eeb-9c32-86aa8faa7b19 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:54.620863 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 542/1063] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:57.118873 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327439d-d5ab-4d7a-b59d-d3043b08432a None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:57.119438 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327439d-d5ab-4d7a-b59d-d3043b08432a None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:57.119438 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327439d-d5ab-4d7a-b59d-d3043b08432a None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:57.120816 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 522/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:57.126436 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3a4e-32c5-434f-a17b-9d47f969975b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:57.126865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3a4e-32c5-434f-a17b-9d47f969975b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:57.126983 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3a4e-32c5-434f-a17b-9d47f969975b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:57.146062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-2a4e3a4e-32c5-434f-a17b-9d47f969975b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:57.147252 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-2a4e3a4e-32c5-434f-a17b-9d47f969975b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:57.154990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 543/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:58:57.506248 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327439d-d5ab-4d7a-b59d-d3043b08432a None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:57.517025 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327439d-d5ab-4d7a-b59d-d3043b08432a None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:57.521584 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1d7cc-d119-4ffa-a5f1-bd33f4ed6105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:57.522310 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d7cc-d119-4ffa-a5f1-bd33f4ed6105 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:57.522479 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d7cc-d119-4ffa-a5f1-bd33f4ed6105 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:57.522746 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d7cc-d119-4ffa-a5f1-bd33f4ed6105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:57.531577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1d7cc-d119-4ffa-a5f1-bd33f4ed6105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:57.533031 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1d7cc-d119-4ffa-a5f1-bd33f4ed6105 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:57.542218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 523/1066] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:59.921277 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8197-1690-4a34-b7d4-a29decbac71c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:59.921927 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8197-1690-4a34-b7d4-a29decbac71c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:59.921927 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8197-1690-4a34-b7d4-a29decbac71c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:59.923235 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 544/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:59.929722 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d4f0-f669-4e29-9f58-6e9c8bb75c10 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:59.930449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d4f0-f669-4e29-9f58-6e9c8bb75c10 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:59.930449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d4f0-f669-4e29-9f58-6e9c8bb75c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:59.949586 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-c275d4f0-f669-4e29-9f58-6e9c8bb75c10 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:59.950808 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c275d4f0-f669-4e29-9f58-6e9c8bb75c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:59.958528 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 524/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:59:00.306792 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba8197-1690-4a34-b7d4-a29decbac71c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:00.318422 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba8197-1690-4a34-b7d4-a29decbac71c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:00.321918 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e18289-f935-4fc8-92ef-e3bb6e0d9dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:00.322501 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18289-f935-4fc8-92ef-e3bb6e0d9dff service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:00.322779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18289-f935-4fc8-92ef-e3bb6e0d9dff service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:00.323049 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18289-f935-4fc8-92ef-e3bb6e0d9dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:00.331903 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e18289-f935-4fc8-92ef-e3bb6e0d9dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:00.333376 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e18289-f935-4fc8-92ef-e3bb6e0d9dff service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:00.343636 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 545/1069] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:02.588591 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb085f-e950-451e-bc96-dfad3c09b874 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:02.589202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb085f-e950-451e-bc96-dfad3c09b874 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:02.589202 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb085f-e950-451e-bc96-dfad3c09b874 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:02.590510 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 525/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:02.596162 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d1837-61a4-4edd-9758-bffdec092959 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:02.596670 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d1837-61a4-4edd-9758-bffdec092959 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:02.597674 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d1837-61a4-4edd-9758-bffdec092959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:02.616999 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-fd3d1837-61a4-4edd-9758-bffdec092959 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:02.618214 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-fd3d1837-61a4-4edd-9758-bffdec092959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:02.625937 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 546/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:59:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:02.965132 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb085f-e950-451e-bc96-dfad3c09b874 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:02.976134 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb085f-e950-451e-bc96-dfad3c09b874 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:02.979575 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19370b01-d1cb-431d-a28f-b89346b74065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:02.980163 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19370b01-d1cb-431d-a28f-b89346b74065 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:02.980438 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19370b01-d1cb-431d-a28f-b89346b74065 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:02.980738 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19370b01-d1cb-431d-a28f-b89346b74065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:02.989562 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19370b01-d1cb-431d-a28f-b89346b74065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:02.990977 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19370b01-d1cb-431d-a28f-b89346b74065 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:03.000221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 526/1072] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:05.275178 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c41c-9cb7-4428-839e-509c00eec00d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:05.275703 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c41c-9cb7-4428-839e-509c00eec00d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:05.275703 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c41c-9cb7-4428-839e-509c00eec00d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:05.277016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 547/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:05.283151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afee23-5643-4e3c-869c-f68a01c87a64 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:05.283596 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afee23-5643-4e3c-869c-f68a01c87a64 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:05.283801 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afee23-5643-4e3c-869c-f68a01c87a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:05.304866 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-99afee23-5643-4e3c-869c-f68a01c87a64 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:05.306087 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-99afee23-5643-4e3c-869c-f68a01c87a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:05.316299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 527/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:59:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:05.668528 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135c41c-9cb7-4428-839e-509c00eec00d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:05.680569 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135c41c-9cb7-4428-839e-509c00eec00d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:05.684052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53fb53-b96f-46a3-80a7-6ac6934d2725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:05.684648 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53fb53-b96f-46a3-80a7-6ac6934d2725 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:05.684962 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53fb53-b96f-46a3-80a7-6ac6934d2725 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:05.685236 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53fb53-b96f-46a3-80a7-6ac6934d2725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:05.694684 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53fb53-b96f-46a3-80a7-6ac6934d2725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:05.696115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53fb53-b96f-46a3-80a7-6ac6934d2725 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:05.705728 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 548/1075] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:07.974245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f425f20-1bbd-49de-8a1a-b59335d5d0ac None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:07.974887 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f425f20-1bbd-49de-8a1a-b59335d5d0ac None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:07.974887 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f425f20-1bbd-49de-8a1a-b59335d5d0ac None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:07.976182 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 528/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:07.981748 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb6b4-ab18-43cb-b230-1a3f99721d63 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:07.982213 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb6b4-ab18-43cb-b230-1a3f99721d63 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:07.982313 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb6b4-ab18-43cb-b230-1a3f99721d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:07.990092 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=70 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:08.003582 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ba2eb6b4-ab18-43cb-b230-1a3f99721d63 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:08.004812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ba2eb6b4-ab18-43cb-b230-1a3f99721d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:08.012527 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 549/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:59:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:08.353123 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f425f20-1bbd-49de-8a1a-b59335d5d0ac None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:08.358691 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=73 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:08.365694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f425f20-1bbd-49de-8a1a-b59335d5d0ac None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:08.369292 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d773f-233a-40f8-b2c1-acb1d28cb0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:08.370000 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d773f-233a-40f8-b2c1-acb1d28cb0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:08.370291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d773f-233a-40f8-b2c1-acb1d28cb0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:08.370559 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d773f-233a-40f8-b2c1-acb1d28cb0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:08.380609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d773f-233a-40f8-b2c1-acb1d28cb0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:08.382089 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d773f-233a-40f8-b2c1-acb1d28cb0d9 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:08.392725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 529/1078] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:10.644312 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc633a2-cf3a-44b8-91c5-03968135b947 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:10.644807 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc633a2-cf3a-44b8-91c5-03968135b947 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:10.645003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc633a2-cf3a-44b8-91c5-03968135b947 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:10.646342 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 550/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:10.651744 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464574-7674-4c67-b8d0-9424521b28fe None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:10.652173 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464574-7674-4c67-b8d0-9424521b28fe None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:10.652285 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99464574-7674-4c67-b8d0-9424521b28fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:10.671166 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-99464574-7674-4c67-b8d0-9424521b28fe None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:10.672364 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-99464574-7674-4c67-b8d0-9424521b28fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:10.680609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 530/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:59:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:11.024116 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc633a2-cf3a-44b8-91c5-03968135b947 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:11.035950 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc633a2-cf3a-44b8-91c5-03968135b947 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:11.039676 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85783dd-8e90-42a0-a9ec-53d2b39ca73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:11.040304 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85783dd-8e90-42a0-a9ec-53d2b39ca73f service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:11.040586 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85783dd-8e90-42a0-a9ec-53d2b39ca73f service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:11.040895 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85783dd-8e90-42a0-a9ec-53d2b39ca73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:11.054156 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85783dd-8e90-42a0-a9ec-53d2b39ca73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:11.055682 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85783dd-8e90-42a0-a9ec-53d2b39ca73f service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:11.067085 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 551/1081] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:59:13.298373 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c4865-3ee6-44c3-aef9-87e78f04285b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:13.298895 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c4865-3ee6-44c3-aef9-87e78f04285b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:13.298895 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c4865-3ee6-44c3-aef9-87e78f04285b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:13.300266 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 531/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:13.306096 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffba3d-cb7e-412b-b4a8-afcfde1aa222 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:13.306538 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffba3d-cb7e-412b-b4a8-afcfde1aa222 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:13.306648 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffba3d-cb7e-412b-b4a8-afcfde1aa222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:13.325743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-02ffba3d-cb7e-412b-b4a8-afcfde1aa222 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:13.326918 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-02ffba3d-cb7e-412b-b4a8-afcfde1aa222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:13.335146 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 552/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:59:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:13.669997 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c4865-3ee6-44c3-aef9-87e78f04285b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:13.681561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c4865-3ee6-44c3-aef9-87e78f04285b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:13.685102 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3da791-b8d2-4dc3-9373-45d3e16ce507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:13.685698 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da791-b8d2-4dc3-9373-45d3e16ce507 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:13.685971 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da791-b8d2-4dc3-9373-45d3e16ce507 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:13.686240 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da791-b8d2-4dc3-9373-45d3e16ce507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:13.696081 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3da791-b8d2-4dc3-9373-45d3e16ce507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:13.697532 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3da791-b8d2-4dc3-9373-45d3e16ce507 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:13.707090 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 532/1084] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:15.909745 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe4209-221e-4e5f-9803-08babed17054 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:15.910308 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe4209-221e-4e5f-9803-08babed17054 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:15.910308 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe4209-221e-4e5f-9803-08babed17054 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:15.911603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 553/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:15.917099 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5c3e-fd41-4857-bd2e-78a96c2c2b3e None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:15.917579 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5c3e-fd41-4857-bd2e-78a96c2c2b3e None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:15.917676 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5c3e-fd41-4857-bd2e-78a96c2c2b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:15.937023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-1def5c3e-fd41-4857-bd2e-78a96c2c2b3e None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:15.938237 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-1def5c3e-fd41-4857-bd2e-78a96c2c2b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:15.945962 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 533/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:59:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:59:16.280739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe4209-221e-4e5f-9803-08babed17054 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:16.291586 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe4209-221e-4e5f-9803-08babed17054 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:16.295093 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193a16c-71df-40ec-9fef-67bf11429359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:16.295688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193a16c-71df-40ec-9fef-67bf11429359 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:16.295965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193a16c-71df-40ec-9fef-67bf11429359 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:16.296235 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193a16c-71df-40ec-9fef-67bf11429359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:16.305593 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193a16c-71df-40ec-9fef-67bf11429359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:16.307013 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193a16c-71df-40ec-9fef-67bf11429359 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:16.316946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 554/1087] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:25.931878 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=17 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:26.312291 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=17 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:40.355384 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1677b-2eca-4469-9218-c985a48d25c5 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:40.355996 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1677b-2eca-4469-9218-c985a48d25c5 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:40.355996 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1677b-2eca-4469-9218-c985a48d25c5 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:40.357301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 534/1088] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:40.363550 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc68d5-aacf-4bfd-ac85-eb28aaec034d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:40.364105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc68d5-aacf-4bfd-ac85-eb28aaec034d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:40.364105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc68d5-aacf-4bfd-ac85-eb28aaec034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:40.382985 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e5cc68d5-aacf-4bfd-ac85-eb28aaec034d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:40.384196 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e5cc68d5-aacf-4bfd-ac85-eb28aaec034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:40.392017 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 555/1089] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:59:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:40.752876 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04221a9-a7b3-49d6-a8ea-f990d21fe17d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:40.753172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04221a9-a7b3-49d6-a8ea-f990d21fe17d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:40.753478 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04221a9-a7b3-49d6-a8ea-f990d21fe17d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:40.754866 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 535/1090] 10.222.0.70 () {54 vars in 967 bytes} [Wed Aug 24 09:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:40.760566 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726972e-24ce-44ef-87d4-3335c3bca9f4 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:40.760880 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726972e-24ce-44ef-87d4-3335c3bca9f4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:40.761151 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726972e-24ce-44ef-87d4-3335c3bca9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:40.781339 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e726972e-24ce-44ef-87d4-3335c3bca9f4 None None] MFA Rules not processed for user `e9039bb844c14a8789c6f30e461f77c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:40.782550 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e726972e-24ce-44ef-87d4-3335c3bca9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:40.789897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 556/1091] 10.222.0.70 () {58 vars in 1064 bytes} [Wed Aug 24 09:59:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:40.797212 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04221a9-a7b3-49d6-a8ea-f990d21fe17d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:40.807917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04221a9-a7b3-49d6-a8ea-f990d21fe17d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:40.811453 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc245-2c2b-4fa1-af03-8f2299cd4a68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9039bb844c14a8789c6f30e461f77c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:40.812040 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc245-2c2b-4fa1-af03-8f2299cd4a68 service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:40.812319 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc245-2c2b-4fa1-af03-8f2299cd4a68 service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:40.812589 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc245-2c2b-4fa1-af03-8f2299cd4a68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:40.821656 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc245-2c2b-4fa1-af03-8f2299cd4a68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:40.823074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc245-2c2b-4fa1-af03-8f2299cd4a68 service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:40.832814 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 536/1092] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:43.104526 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9d25-e77f-4890-909e-dd7c45a9fb18 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:43.105139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9d25-e77f-4890-909e-dd7c45a9fb18 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:43.105139 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9d25-e77f-4890-909e-dd7c45a9fb18 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:43.106430 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 557/1093] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:43.114126 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76132-d4d6-4d45-bd62-4b93fc141123 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:43.114664 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76132-d4d6-4d45-bd62-4b93fc141123 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:43.115038 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76132-d4d6-4d45-bd62-4b93fc141123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:43.136608 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-0ea76132-d4d6-4d45-bd62-4b93fc141123 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:43.137874 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-0ea76132-d4d6-4d45-bd62-4b93fc141123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:43.146369 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 537/1094] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:59:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:43.485772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb9d25-e77f-4890-909e-dd7c45a9fb18 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:43.498109 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb9d25-e77f-4890-909e-dd7c45a9fb18 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:43.502952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6a45a-97a2-49fd-a4fc-e4d6e628b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:43.503547 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6a45a-97a2-49fd-a4fc-e4d6e628b110 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:43.503824 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6a45a-97a2-49fd-a4fc-e4d6e628b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:43.504094 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6a45a-97a2-49fd-a4fc-e4d6e628b110 admin admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:43.504762 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6a45a-97a2-49fd-a4fc-e4d6e628b110 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:43.506477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-bcd6a45a-97a2-49fd-a4fc-e4d6e628b110 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:59:43.506477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: warnings.warn(msg) Aug 24 09:59:43.506477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: Aug 24 09:59:43.507623 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6a45a-97a2-49fd-a4fc-e4d6e628b110 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:43.526141 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 558/1095] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 24 09:59:43 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:59:45.742561 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088ebf-eb0d-4f26-a442-5e9130d7272d None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:45.743187 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088ebf-eb0d-4f26-a442-5e9130d7272d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:45.743187 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee088ebf-eb0d-4f26-a442-5e9130d7272d None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:45.744470 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 538/1096] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:45.749831 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5cb1-c6f3-4495-bcb4-a20afb479509 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:45.750283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5cb1-c6f3-4495-bcb4-a20afb479509 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:45.750389 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5cb1-c6f3-4495-bcb4-a20afb479509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:45.769826 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-e26e5cb1-c6f3-4495-bcb4-a20afb479509 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:45.771016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-e26e5cb1-c6f3-4495-bcb4-a20afb479509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:45.778754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 559/1097] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:59:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:46.129113 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee088ebf-eb0d-4f26-a442-5e9130d7272d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:46.143565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee088ebf-eb0d-4f26-a442-5e9130d7272d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:46.148736 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008096a-eac1-4807-974f-daf163615b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:46.149340 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008096a-eac1-4807-974f-daf163615b43 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:46.149624 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008096a-eac1-4807-974f-daf163615b43 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:46.149898 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008096a-eac1-4807-974f-daf163615b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:46.158377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008096a-eac1-4807-974f-daf163615b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:46.159969 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008096a-eac1-4807-974f-daf163615b43 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:46.169516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 539/1098] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:48.569136 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c885314-4683-4f4c-aff3-72621264cc4c None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:48.569706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c885314-4683-4f4c-aff3-72621264cc4c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:48.569706 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c885314-4683-4f4c-aff3-72621264cc4c None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:48.571111 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 560/1099] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:48.576525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6e38-865e-48bc-ac7c-97241e4ececd None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:48.577031 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6e38-865e-48bc-ac7c-97241e4ececd None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:48.577137 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6e38-865e-48bc-ac7c-97241e4ececd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:48.596757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-ab3f6e38-865e-48bc-ac7c-97241e4ececd None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:48.597957 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ab3f6e38-865e-48bc-ac7c-97241e4ececd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:48.605991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 540/1100] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:59:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:48.947426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c885314-4683-4f4c-aff3-72621264cc4c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:48.958209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c885314-4683-4f4c-aff3-72621264cc4c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:48.961735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c2b2-334c-41b2-ae22-e58b458a4245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:48.962340 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c2b2-334c-41b2-ae22-e58b458a4245 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:48.962618 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c2b2-334c-41b2-ae22-e58b458a4245 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:48.962892 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c2b2-334c-41b2-ae22-e58b458a4245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:48.972583 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1c2b2-334c-41b2-ae22-e58b458a4245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:48.974043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1c2b2-334c-41b2-ae22-e58b458a4245 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:48.983552 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 561/1101] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:51.237686 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea0d1-6f0c-4053-a6b3-1da8b47b3319 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:51.238228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea0d1-6f0c-4053-a6b3-1da8b47b3319 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:51.238228 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea0d1-6f0c-4053-a6b3-1da8b47b3319 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:51.239577 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 541/1102] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:51.245151 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a560a-8221-4c7c-81f0-011345705f07 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:51.245644 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a560a-8221-4c7c-81f0-011345705f07 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:51.245756 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a560a-8221-4c7c-81f0-011345705f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:51.265754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-132a560a-8221-4c7c-81f0-011345705f07 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:51.267462 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-132a560a-8221-4c7c-81f0-011345705f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:51.280640 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 562/1103] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:59:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:51.628605 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ea0d1-6f0c-4053-a6b3-1da8b47b3319 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:51.639478 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ea0d1-6f0c-4053-a6b3-1da8b47b3319 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:51.643677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a03be-12f8-4732-bdc4-419635153eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:51.644269 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a03be-12f8-4732-bdc4-419635153eda service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:51.644583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a03be-12f8-4732-bdc4-419635153eda service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:51.644946 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a03be-12f8-4732-bdc4-419635153eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:51.654101 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a03be-12f8-4732-bdc4-419635153eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:51.655526 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a03be-12f8-4732-bdc4-419635153eda service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:51.665196 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 542/1104] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:53.946245 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca132-dc71-4730-9721-128ad01f6fde None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:53.946772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca132-dc71-4730-9721-128ad01f6fde None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:53.946878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fca132-dc71-4730-9721-128ad01f6fde None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:53.948118 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 563/1105] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:53.953966 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65a21-fda5-4e4a-9097-871ed694de86 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:53.954445 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65a21-fda5-4e4a-9097-871ed694de86 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:53.954538 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65a21-fda5-4e4a-9097-871ed694de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:53.974212 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-b7c65a21-fda5-4e4a-9097-871ed694de86 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:53.975412 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-b7c65a21-fda5-4e4a-9097-871ed694de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:53.983156 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 543/1106] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:59:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:59:54.331685 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fca132-dc71-4730-9721-128ad01f6fde None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:54.342679 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fca132-dc71-4730-9721-128ad01f6fde None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:54.346784 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047f5aa-3fcf-4680-946e-4a34b75dca5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:54.347381 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f5aa-3fcf-4680-946e-4a34b75dca5b service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:54.347661 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f5aa-3fcf-4680-946e-4a34b75dca5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:54.347942 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f5aa-3fcf-4680-946e-4a34b75dca5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:54.357225 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047f5aa-3fcf-4680-946e-4a34b75dca5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:54.358661 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047f5aa-3fcf-4680-946e-4a34b75dca5b service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:54.368673 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 564/1107] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:56.775118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb77a0-8fa0-4912-92dd-ec7c79910b71 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:56.775676 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb77a0-8fa0-4912-92dd-ec7c79910b71 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:56.775676 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb77a0-8fa0-4912-92dd-ec7c79910b71 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:56.777049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 544/1108] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 24 09:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:59:56.782287 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d358ef-adb6-4841-9779-c5e76cce0a7a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:56.783237 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d358ef-adb6-4841-9779-c5e76cce0a7a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:56.783388 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d358ef-adb6-4841-9779-c5e76cce0a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:56.802740 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-d4d358ef-adb6-4841-9779-c5e76cce0a7a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:56.803923 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-d4d358ef-adb6-4841-9779-c5e76cce0a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:56.811850 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 565/1109] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 24 09:59:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:59:57.160335 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb77a0-8fa0-4912-92dd-ec7c79910b71 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:57.171512 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb77a0-8fa0-4912-92dd-ec7c79910b71 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:57.174977 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b36519-0b04-4890-b5fc-b83af8898122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:57.175602 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36519-0b04-4890-b5fc-b83af8898122 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:57.175910 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36519-0b04-4890-b5fc-b83af8898122 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:57.176184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b36519-0b04-4890-b5fc-b83af8898122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:57.185396 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b36519-0b04-4890-b5fc-b83af8898122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:57.186861 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b36519-0b04-4890-b5fc-b83af8898122 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:57.196934 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 545/1110] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:06.797425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=33 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:07.192322 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=33 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:11.428525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178088-75ad-4f48-afec-abcad649e54c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.429190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178088-75ad-4f48-afec-abcad649e54c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.429190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178088-75ad-4f48-afec-abcad649e54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.450700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-0a178088-75ad-4f48-afec-abcad649e54c None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:11.451991 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-0a178088-75ad-4f48-afec-abcad649e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.459791 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 566/1111] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:11.468247 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878cf8e-c3af-4245-9340-3cec5404ff87 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.468777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878cf8e-c3af-4245-9340-3cec5404ff87 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.469003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878cf8e-c3af-4245-9340-3cec5404ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.489008 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-4878cf8e-c3af-4245-9340-3cec5404ff87 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:11.490212 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-4878cf8e-c3af-4245-9340-3cec5404ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.498384 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 546/1112] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:11.503536 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a178088-75ad-4f48-afec-abcad649e54c None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.513311 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a178088-75ad-4f48-afec-abcad649e54c None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.518012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.518613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.518894 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.519169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.519810 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:11.520114 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.521217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:11.521217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: warnings.warn(msg) Aug 24 10:01:11.521217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: Aug 24 10:01:11.522145 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.533709 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 567/1113] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:11.541838 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878cf8e-c3af-4245-9340-3cec5404ff87 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.551618 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878cf8e-c3af-4245-9340-3cec5404ff87 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.556148 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.556768 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.557052 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.557326 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.557946 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.559837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:11.559837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: warnings.warn(msg) Aug 24 10:01:11.559837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: Aug 24 10:01:11.561097 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.588594 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 547/1114] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:11.593160 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.602871 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea648f-f1fd-4d81-997a-c8b757ea7588 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.658725 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.659323 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.659601 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.659873 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.660492 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.661520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:11.661520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: warnings.warn(msg) Aug 24 10:01:11.661520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: Aug 24 10:01:11.662718 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.683053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 568/1115] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:11.687271 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.697469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4548576-bc17-4729-bed7-8f726f8b5bd4 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.702254 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.702838 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.703106 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.703374 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.703998 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.705015 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:11.705015 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: warnings.warn(msg) Aug 24 10:01:11.705015 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: Aug 24 10:01:11.705898 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.719111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 548/1116] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:01:11.723855 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.734344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa11f3d-d340-4941-b80e-f1442b1fe65e admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.739016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf576f1-cf2d-494a-b158-4a3a3ea10e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.739603 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf576f1-cf2d-494a-b158-4a3a3ea10e20 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.739879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf576f1-cf2d-494a-b158-4a3a3ea10e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.740169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf576f1-cf2d-494a-b158-4a3a3ea10e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.740815 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf576f1-cf2d-494a-b158-4a3a3ea10e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.741812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-6bf576f1-cf2d-494a-b158-4a3a3ea10e20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:11.741812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: warnings.warn(msg) Aug 24 10:01:11.741812 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: Aug 24 10:01:11.742690 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf576f1-cf2d-494a-b158-4a3a3ea10e20 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.755793 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 569/1117] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:11.760189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.769984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28773014-c821-41bd-807a-3de37b41805a admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.774517 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5d8d5-74ae-41bc-a932-b07f830d01fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.775153 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d8d5-74ae-41bc-a932-b07f830d01fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.775434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d8d5-74ae-41bc-a932-b07f830d01fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.775703 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d8d5-74ae-41bc-a932-b07f830d01fd admin admin] PATH_INFO: `/v3/projects/f8d5aa89f310434aa2aaced3d2ecd7d7/users/846f245326794d81b93c68d5a3eb4650/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.791039 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5d8d5-74ae-41bc-a932-b07f830d01fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d5aa89f310434aa2aaced3d2ecd7d7, user_id=846f245326794d81b93c68d5a3eb4650, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.792048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-32a5d8d5-74ae-41bc-a932-b07f830d01fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:11.792048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: warnings.warn(msg) Aug 24 10:01:11.792048 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: Aug 24 10:01:11.794041 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5d8d5-74ae-41bc-a932-b07f830d01fd admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.807497 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 549/1118] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:11 2022] PUT /identity/v3/projects/f8d5aa89f310434aa2aaced3d2ecd7d7/users/846f245326794d81b93c68d5a3eb4650/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:11.819480 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161807dd-7e5c-4ef6-a748-bdf56bb44497 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.819761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161807dd-7e5c-4ef6-a748-bdf56bb44497 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.820034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161807dd-7e5c-4ef6-a748-bdf56bb44497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.848081 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-161807dd-7e5c-4ef6-a748-bdf56bb44497 None None] MFA Rules not processed for user `846f245326794d81b93c68d5a3eb4650`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:11.849333 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-161807dd-7e5c-4ef6-a748-bdf56bb44497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.912109 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 570/1119] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:11.925724 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abe8a1-4e3c-4631-802c-1cca0797a1dc None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.926006 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abe8a1-4e3c-4631-802c-1cca0797a1dc None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.926281 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abe8a1-4e3c-4631-802c-1cca0797a1dc None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.927591 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 550/1120] 10.222.0.70 () {54 vars in 964 bytes} [Wed Aug 24 10:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:01:11.932434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325365a-743b-4349-9539-487a97accd15 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.932761 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325365a-743b-4349-9539-487a97accd15 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.933042 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325365a-743b-4349-9539-487a97accd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.952033 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-3325365a-743b-4349-9539-487a97accd15 None None] MFA Rules not processed for user `7712bef2122745c3b05aad9e4dff7c12`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:11.953194 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3325365a-743b-4349-9539-487a97accd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.996014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:12.004580 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 571/1121] 10.222.0.70 () {58 vars in 1061 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:12.012280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abe8a1-4e3c-4631-802c-1cca0797a1dc None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.023221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abe8a1-4e3c-4631-802c-1cca0797a1dc None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.026694 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb251e-8d75-4848-b98c-74737c7a068d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7712bef2122745c3b05aad9e4dff7c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.027281 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb251e-8d75-4848-b98c-74737c7a068d service cinder] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.027560 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb251e-8d75-4848-b98c-74737c7a068d service cinder] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.027831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb251e-8d75-4848-b98c-74737c7a068d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.036641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb251e-8d75-4848-b98c-74737c7a068d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.038105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb251e-8d75-4848-b98c-74737c7a068d service cinder] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.046883 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 551/1122] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:12 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:12.085061 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a3e6-1101-496c-a53b-5ca2f0e823d1 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.085377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a3e6-1101-496c-a53b-5ca2f0e823d1 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.085656 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a3e6-1101-496c-a53b-5ca2f0e823d1 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.086903 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 572/1123] 10.222.0.70 () {52 vars in 830 bytes} [Wed Aug 24 10:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:01:12.090503 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb251e-8d75-4848-b98c-74737c7a068d service cinder] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.153822 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb251e-8d75-4848-b98c-74737c7a068d service cinder] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.158991 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.159610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.159898 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.160177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] PATH_INFO: `/v3/users/846f245326794d81b93c68d5a3eb4650` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.161333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846f245326794d81b93c68d5a3eb4650)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.162461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:12.162461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: warnings.warn(msg) Aug 24 10:01:12.162461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: Aug 24 10:01:12.163566 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.232165 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846f245326794d81b93c68d5a3eb4650'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.250774 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846f245326794d81b93c68d5a3eb4650'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.251584 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846f245326794d81b93c68d5a3eb4650'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.252207 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846f245326794d81b93c68d5a3eb4650'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.261968 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846f245326794d81b93c68d5a3eb4650'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.291245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 552/1124] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:12 2022] DELETE /identity/v3/users/846f245326794d81b93c68d5a3eb4650 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:12.295629 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07e6c6-7fcf-4620-b70b-ad3694a583aa None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.295920 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07e6c6-7fcf-4620-b70b-ad3694a583aa None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.296200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07e6c6-7fcf-4620-b70b-ad3694a583aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.314902 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-1b07e6c6-7fcf-4620-b70b-ad3694a583aa None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:12.316122 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1b07e6c6-7fcf-4620-b70b-ad3694a583aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.374045 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 573/1125] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:01:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:12.383481 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.384941 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.392005 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:12.447510 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1c27a-2f10-46ad-8eba-282424dae297 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.451150 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ecdb6-881a-4abd-8686-63428f0fd785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.451837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ecdb6-881a-4abd-8686-63428f0fd785 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.452607 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ecdb6-881a-4abd-8686-63428f0fd785 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.452912 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ecdb6-881a-4abd-8686-63428f0fd785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.461712 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ecdb6-881a-4abd-8686-63428f0fd785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.463140 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ecdb6-881a-4abd-8686-63428f0fd785 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.475291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 553/1126] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:01:12.814020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07e6c6-7fcf-4620-b70b-ad3694a583aa None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.815579 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1b07e6c6-7fcf-4620-b70b-ad3694a583aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.827477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07e6c6-7fcf-4620-b70b-ad3694a583aa None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.832152 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.832864 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.833147 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.833420 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] PATH_INFO: `/v3/projects/f8d5aa89f310434aa2aaced3d2ecd7d7` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.834549 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d5aa89f310434aa2aaced3d2ecd7d7)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.835559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:01:12.835559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: warnings.warn(msg) Aug 24 10:01:12.835559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: Aug 24 10:01:12.836788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.906691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d5aa89f310434aa2aaced3d2ecd7d7', 'request_id': 'req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.921394 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d5aa89f310434aa2aaced3d2ecd7d7', 'request_id': 'req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.928155 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d5aa89f310434aa2aaced3d2ecd7d7', 'request_id': 'req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.944399 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] The token cache is being invalidate because project f8d5aa89f310434aa2aaced3d2ecd7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:12.944715 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.945418 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-d087c602-f4b8-46d1-8a9e-9d5c6ce55597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.946910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 574/1127] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:12 2022] DELETE /identity/v3/projects/f8d5aa89f310434aa2aaced3d2ecd7d7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:22.473930 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=25 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:22.941316 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:35.584593 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873446-2620-4b01-a6e1-6b38f663301b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:35.585224 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873446-2620-4b01-a6e1-6b38f663301b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:35.585224 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873446-2620-4b01-a6e1-6b38f663301b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:35.586544 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 554/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:02:35.591253 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba046b-dbc5-4977-b608-431cb534f3ee None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:35.591703 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba046b-dbc5-4977-b608-431cb534f3ee None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:35.591806 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba046b-dbc5-4977-b608-431cb534f3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:35.662497 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-1dba046b-dbc5-4977-b608-431cb534f3ee None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:35.663701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1dba046b-dbc5-4977-b608-431cb534f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:35.754830 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 575/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:02:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:35.913244 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873446-2620-4b01-a6e1-6b38f663301b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:35.914979 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-82873446-2620-4b01-a6e1-6b38f663301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:36.003967 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873446-2620-4b01-a6e1-6b38f663301b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:36.008899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09309e-be10-4838-840e-36f373a3fda7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:36.009498 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09309e-be10-4838-840e-36f373a3fda7 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:36.009777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09309e-be10-4838-840e-36f373a3fda7 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:36.010049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09309e-be10-4838-840e-36f373a3fda7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:36.018017 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09309e-be10-4838-840e-36f373a3fda7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:36.019578 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09309e-be10-4838-840e-36f373a3fda7 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:36.034631 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 555/1130] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:36.863828 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83ec3-26e6-4d72-9924-97beab74dabe None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:36.864363 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83ec3-26e6-4d72-9924-97beab74dabe None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:36.864363 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83ec3-26e6-4d72-9924-97beab74dabe None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:36.865711 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 576/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:02:36.870545 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9012a-b093-4b97-ac39-4274c4f2ecc0 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:36.870950 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9012a-b093-4b97-ac39-4274c4f2ecc0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:36.871103 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9012a-b093-4b97-ac39-4274c4f2ecc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:36.890977 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-9dc9012a-b093-4b97-ac39-4274c4f2ecc0 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:36.892178 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-9dc9012a-b093-4b97-ac39-4274c4f2ecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:36.899798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 556/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:02:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:37.056330 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a83ec3-26e6-4d72-9924-97beab74dabe None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:37.069825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a83ec3-26e6-4d72-9924-97beab74dabe None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:37.074641 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bfe59-1326-46d1-92b8-4d48ac5d2c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:37.075214 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bfe59-1326-46d1-92b8-4d48ac5d2c2c service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:37.075491 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bfe59-1326-46d1-92b8-4d48ac5d2c2c service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:37.075759 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bfe59-1326-46d1-92b8-4d48ac5d2c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:37.084256 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bfe59-1326-46d1-92b8-4d48ac5d2c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:37.085865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bfe59-1326-46d1-92b8-4d48ac5d2c2c service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:37.095561 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 577/1133] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:41.651481 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50420426-33b4-4e9c-86b5-24b29ea3a91c None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:41.651999 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50420426-33b4-4e9c-86b5-24b29ea3a91c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:41.651999 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50420426-33b4-4e9c-86b5-24b29ea3a91c None None] PATH_INFO: `/v3` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:41.653262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 557/1134] 10.222.0.77 () {54 vars in 925 bytes} [Wed Aug 24 10:02:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:41.659063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef347-5f96-44a0-a873-6d2ed56403f6 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:41.659517 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef347-5f96-44a0-a873-6d2ed56403f6 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:41.659627 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef347-5f96-44a0-a873-6d2ed56403f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:41.688413 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-640ef347-5f96-44a0-a873-6d2ed56403f6 None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:41.689643 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-640ef347-5f96-44a0-a873-6d2ed56403f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:41.740895 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:41.751098 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 578/1135] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Aug 24 10:02:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:46.885647 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=42 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:48.327074 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525445-b559-4b6a-b86f-1376609f2560 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:48.327729 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525445-b559-4b6a-b86f-1376609f2560 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:48.327729 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525445-b559-4b6a-b86f-1376609f2560 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:48.329016 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 558/1136] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:02:48.333686 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227a8b-c3c0-4998-b71c-63053e08ba6a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:48.334103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227a8b-c3c0-4998-b71c-63053e08ba6a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:48.334220 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227a8b-c3c0-4998-b71c-63053e08ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:48.354949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f0227a8b-c3c0-4998-b71c-63053e08ba6a None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:48.356129 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f0227a8b-c3c0-4998-b71c-63053e08ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:48.364508 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 579/1137] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:02:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:48.523226 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525445-b559-4b6a-b86f-1376609f2560 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:48.537407 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525445-b559-4b6a-b86f-1376609f2560 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:48.542398 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dc908-fe92-4fbc-834a-bedbe88a5db9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:48.542992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc908-fe92-4fbc-834a-bedbe88a5db9 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:48.543268 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc908-fe92-4fbc-834a-bedbe88a5db9 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:48.543543 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dc908-fe92-4fbc-834a-bedbe88a5db9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:48.553144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc908-fe92-4fbc-834a-bedbe88a5db9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:48.555152 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dc908-fe92-4fbc-834a-bedbe88a5db9 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:48.564436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 559/1138] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:49.382487 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c6a2-a429-4037-9949-056673949c73 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:49.383065 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c6a2-a429-4037-9949-056673949c73 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:49.383065 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33c6a2-a429-4037-9949-056673949c73 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:49.384366 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 580/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:02:49.389023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14490d-13bb-48c4-b70d-909db2c49502 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:49.389416 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14490d-13bb-48c4-b70d-909db2c49502 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:49.389581 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14490d-13bb-48c4-b70d-909db2c49502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:49.408931 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-2b14490d-13bb-48c4-b70d-909db2c49502 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:49.410116 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-2b14490d-13bb-48c4-b70d-909db2c49502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:49.417831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 560/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:02:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:49.573053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33c6a2-a429-4037-9949-056673949c73 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:49.587062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33c6a2-a429-4037-9949-056673949c73 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:49.592274 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ffab7-3884-44c0-b540-5d3a9b0ebb12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:49.592888 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ffab7-3884-44c0-b540-5d3a9b0ebb12 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:49.593165 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ffab7-3884-44c0-b540-5d3a9b0ebb12 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:49.593433 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ffab7-3884-44c0-b540-5d3a9b0ebb12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:49.602232 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ffab7-3884-44c0-b540-5d3a9b0ebb12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:49.603807 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ffab7-3884-44c0-b540-5d3a9b0ebb12 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:49.613352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 581/1141] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:50.829713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820ce3-b128-4717-b932-3053fc2da220 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:50.830248 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820ce3-b128-4717-b932-3053fc2da220 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:50.830248 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820ce3-b128-4717-b932-3053fc2da220 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:50.831596 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 561/1142] 10.222.0.70 () {54 vars in 961 bytes} [Wed Aug 24 10:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:02:50.836618 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0d476-ed53-4c0f-8ebd-ef468b2b48c5 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:50.837061 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0d476-ed53-4c0f-8ebd-ef468b2b48c5 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:50.837202 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0d476-ed53-4c0f-8ebd-ef468b2b48c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:50.856917 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-04c0d476-ed53-4c0f-8ebd-ef468b2b48c5 None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:50.858106 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-04c0d476-ed53-4c0f-8ebd-ef468b2b48c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:50.867269 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 582/1143] 10.222.0.70 () {58 vars in 1058 bytes} [Wed Aug 24 10:02:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:50.874811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820ce3-b128-4717-b932-3053fc2da220 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:50.888033 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820ce3-b128-4717-b932-3053fc2da220 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:50.893136 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3d960-83f2-46fb-91b4-2ed44bff420a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520fac97915740c38318e2a8664cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:50.893731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3d960-83f2-46fb-91b4-2ed44bff420a service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:50.894016 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3d960-83f2-46fb-91b4-2ed44bff420a service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:50.894294 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3d960-83f2-46fb-91b4-2ed44bff420a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:50.902563 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3d960-83f2-46fb-91b4-2ed44bff420a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:50.904267 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3d960-83f2-46fb-91b4-2ed44bff420a service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:50.914895 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 562/1144] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:50 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:00.837251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764972-b2fc-4a10-8a12-976fa053828d None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:00.837779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764972-b2fc-4a10-8a12-976fa053828d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:00.837779 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764972-b2fc-4a10-8a12-976fa053828d None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:00.839127 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 583/1145] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:00.844034 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd263ec-ec7a-460a-abdf-5b16059abefd None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:00.844456 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd263ec-ec7a-460a-abdf-5b16059abefd None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:00.844599 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd263ec-ec7a-460a-abdf-5b16059abefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:00.852000 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=12 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:00.864270 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6bd263ec-ec7a-460a-abdf-5b16059abefd None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:00.865519 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6bd263ec-ec7a-460a-abdf-5b16059abefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:00.873467 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 563/1146] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:03:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:01.032586 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66764972-b2fc-4a10-8a12-976fa053828d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:01.047238 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66764972-b2fc-4a10-8a12-976fa053828d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:01.052099 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab9a3-c230-43d0-9e82-a64e3f3f8e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:01.052702 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab9a3-c230-43d0-9e82-a64e3f3f8e90 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:01.052984 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab9a3-c230-43d0-9e82-a64e3f3f8e90 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:01.053254 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab9a3-c230-43d0-9e82-a64e3f3f8e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:01.061246 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab9a3-c230-43d0-9e82-a64e3f3f8e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:01.063472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab9a3-c230-43d0-9e82-a64e3f3f8e90 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:01.073155 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 584/1147] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:01.890671 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cc5f-c0d9-45cb-8655-4ea8e11ae99b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:01.891253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cc5f-c0d9-45cb-8655-4ea8e11ae99b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:01.891253 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cc5f-c0d9-45cb-8655-4ea8e11ae99b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:01.892552 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 564/1148] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:01.897566 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1fdc2-5727-4cf6-87e6-cea0eeac381b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:01.898003 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1fdc2-5727-4cf6-87e6-cea0eeac381b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:01.898112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1fdc2-5727-4cf6-87e6-cea0eeac381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:01.917963 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-14b1fdc2-5727-4cf6-87e6-cea0eeac381b None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:01.919152 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-14b1fdc2-5727-4cf6-87e6-cea0eeac381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:01.927444 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 585/1149] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:03:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:02.082886 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6cc5f-c0d9-45cb-8655-4ea8e11ae99b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:02.097010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6cc5f-c0d9-45cb-8655-4ea8e11ae99b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:02.101968 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94f152-febb-4a90-9a5d-a692144f1260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:02.102569 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f152-febb-4a90-9a5d-a692144f1260 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:02.102850 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f152-febb-4a90-9a5d-a692144f1260 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:02.106565 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94f152-febb-4a90-9a5d-a692144f1260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:02.112288 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94f152-febb-4a90-9a5d-a692144f1260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:02.113916 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94f152-febb-4a90-9a5d-a692144f1260 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:02.123451 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 565/1150] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:06.223187 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc26695-d72c-41a3-a108-8254962fd8fe None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:06.223861 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc26695-d72c-41a3-a108-8254962fd8fe None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:06.223861 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc26695-d72c-41a3-a108-8254962fd8fe None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:06.224985 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 586/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:06.230268 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1eae7-6512-4c8c-99b3-4a305a0d2ddd None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:06.230699 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1eae7-6512-4c8c-99b3-4a305a0d2ddd None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:06.230797 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1eae7-6512-4c8c-99b3-4a305a0d2ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:06.259223 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-06c1eae7-6512-4c8c-99b3-4a305a0d2ddd None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:06.260427 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-06c1eae7-6512-4c8c-99b3-4a305a0d2ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:06.268258 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 566/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:03:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:06.612015 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc26695-d72c-41a3-a108-8254962fd8fe None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:06.613755 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1cc26695-d72c-41a3-a108-8254962fd8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:06.671367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc26695-d72c-41a3-a108-8254962fd8fe None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:06.675471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a10cf6-dd62-436a-a802-41080f32ab26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:06.676069 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10cf6-dd62-436a-a802-41080f32ab26 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:06.676344 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10cf6-dd62-436a-a802-41080f32ab26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:06.676615 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10cf6-dd62-436a-a802-41080f32ab26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:06.685549 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a10cf6-dd62-436a-a802-41080f32ab26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:06.686909 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a10cf6-dd62-436a-a802-41080f32ab26 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:06.696289 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 587/1153] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:08.891959 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca3dc-22a7-496e-a5d4-4cc2e260ef7b None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:08.892513 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca3dc-22a7-496e-a5d4-4cc2e260ef7b None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:08.892513 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca3dc-22a7-496e-a5d4-4cc2e260ef7b None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:08.893937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 567/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:08.899395 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efc07-a617-4818-9b20-275d583071bc None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:08.899792 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efc07-a617-4818-9b20-275d583071bc None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:08.899942 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efc07-a617-4818-9b20-275d583071bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:08.919542 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-c14efc07-a617-4818-9b20-275d583071bc None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:08.920801 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c14efc07-a617-4818-9b20-275d583071bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:08.929328 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 588/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:03:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:09.270502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ca3dc-22a7-496e-a5d4-4cc2e260ef7b None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:09.281164 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ca3dc-22a7-496e-a5d4-4cc2e260ef7b None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:09.284617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb015cc1-2f03-4944-bffc-424beaf8bf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:09.285243 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015cc1-2f03-4944-bffc-424beaf8bf4d service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:09.285523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015cc1-2f03-4944-bffc-424beaf8bf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:09.285794 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015cc1-2f03-4944-bffc-424beaf8bf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:09.294580 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb015cc1-2f03-4944-bffc-424beaf8bf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:09.296002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb015cc1-2f03-4944-bffc-424beaf8bf4d service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:09.305779 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 568/1156] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:12.961367 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959410-775e-42f8-bff3-a2b78999ad00 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:12.961897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959410-775e-42f8-bff3-a2b78999ad00 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:12.961897 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959410-775e-42f8-bff3-a2b78999ad00 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:12.963208 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 589/1157] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:12.969472 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759a08-5be9-4757-8134-1a3d08eccf74 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:12.969882 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759a08-5be9-4757-8134-1a3d08eccf74 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:12.970009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d759a08-5be9-4757-8134-1a3d08eccf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:12.989143 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-7d759a08-5be9-4757-8134-1a3d08eccf74 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:12.990331 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-7d759a08-5be9-4757-8134-1a3d08eccf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:12.998241 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 569/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:03:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:13.578932 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d959410-775e-42f8-bff3-a2b78999ad00 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:13.580604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3d959410-775e-42f8-bff3-a2b78999ad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:13.639716 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d959410-775e-42f8-bff3-a2b78999ad00 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:13.643239 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b936b-7f00-4be9-8a45-5af5fec18484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7712bef2122745c3b05aad9e4dff7c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:13.643834 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b936b-7f00-4be9-8a45-5af5fec18484 service cinder] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:13.644110 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b936b-7f00-4be9-8a45-5af5fec18484 service cinder] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:13.644380 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b936b-7f00-4be9-8a45-5af5fec18484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:13.653330 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b936b-7f00-4be9-8a45-5af5fec18484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:13.654746 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b936b-7f00-4be9-8a45-5af5fec18484 service cinder] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:13.664284 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 590/1159] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:15.895634 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51787b-253e-4983-9542-319feccb0dc3 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:15.896211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51787b-253e-4983-9542-319feccb0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:15.896211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51787b-253e-4983-9542-319feccb0dc3 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:15.897547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 570/1160] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:15.902905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ca7d-fecd-4a70-939f-4581c617b0c4 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:15.903378 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ca7d-fecd-4a70-939f-4581c617b0c4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:15.903477 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5ca7d-fecd-4a70-939f-4581c617b0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:15.923459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-04b5ca7d-fecd-4a70-939f-4581c617b0c4 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:15.924724 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-04b5ca7d-fecd-4a70-939f-4581c617b0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:15.932551 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 591/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:03:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:16.519649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51787b-253e-4983-9542-319feccb0dc3 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:16.521355 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-ac51787b-253e-4983-9542-319feccb0dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:16.547384 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51787b-253e-4983-9542-319feccb0dc3 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:16.551343 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185da148-ba47-49d0-bf1a-79bc69dcb228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7712bef2122745c3b05aad9e4dff7c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:16.551943 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da148-ba47-49d0-bf1a-79bc69dcb228 service cinder] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:16.552221 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da148-ba47-49d0-bf1a-79bc69dcb228 service cinder] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:16.552491 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da148-ba47-49d0-bf1a-79bc69dcb228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:16.561831 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185da148-ba47-49d0-bf1a-79bc69dcb228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:16.563259 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185da148-ba47-49d0-bf1a-79bc69dcb228 service cinder] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:16.573072 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 571/1162] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:25.917438 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=67 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:26.568752 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=47 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:32.750123 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86458-aaeb-455f-8cf8-6fd242c84650 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:32.751379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86458-aaeb-455f-8cf8-6fd242c84650 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:32.751379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86458-aaeb-455f-8cf8-6fd242c84650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:32.770716 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c2c8-9d5e-4027-9da6-cefcda3e9cdc None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:32.771353 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c2c8-9d5e-4027-9da6-cefcda3e9cdc None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:32.771353 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c2c8-9d5e-4027-9da6-cefcda3e9cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:32.775346 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-30a86458-aaeb-455f-8cf8-6fd242c84650 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:32.791547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-1723c2c8-9d5e-4027-9da6-cefcda3e9cdc None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:32.838807 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-1723c2c8-9d5e-4027-9da6-cefcda3e9cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:32.839053 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-30a86458-aaeb-455f-8cf8-6fd242c84650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:32.847614 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 572/1163] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:32.850591 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 592/1164] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:32.855953 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062224d-beec-4e6a-b262-cca0812b7f2d None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:32.856279 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062224d-beec-4e6a-b262-cca0812b7f2d None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:32.856557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062224d-beec-4e6a-b262-cca0812b7f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:32.858168 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1168f-e2c4-47aa-b22d-f3513fa5a2cd None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:32.858448 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1168f-e2c4-47aa-b22d-f3513fa5a2cd None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:32.858718 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1168f-e2c4-47aa-b22d-f3513fa5a2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:32.877765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3062224d-beec-4e6a-b262-cca0812b7f2d None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:32.878624 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-86f1168f-e2c4-47aa-b22d-f3513fa5a2cd None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:32.878993 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3062224d-beec-4e6a-b262-cca0812b7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:32.879808 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-86f1168f-e2c4-47aa-b22d-f3513fa5a2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:32.887341 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 573/1165] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:32.889076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 593/1166] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:32.894211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062224d-beec-4e6a-b262-cca0812b7f2d None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:32.894532 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1168f-e2c4-47aa-b22d-f3513fa5a2cd None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:32.904630 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062224d-beec-4e6a-b262-cca0812b7f2d None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:32.904922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1168f-e2c4-47aa-b22d-f3513fa5a2cd None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:32.909621 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:32.909802 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:32.910558 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:32.910653 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:32.910743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:32.910743 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] PATH_INFO: `/v3/domains` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:32.910902 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:32.911024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] PATH_INFO: `/v3/domains` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:32.911396 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:04:32.911661 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:04:32.911765 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:32.911949 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:32.913111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:04:32.913111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: warnings.warn(msg) Aug 24 10:04:32.913111 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: Aug 24 10:04:32.913403 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:32.914146 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:32.932751 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 594/1168] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 24 10:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:04:32.933058 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 574/1168] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 24 10:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:04:32.936076 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:32.937487 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:32.946460 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f5b96-2bea-48d3-97dd-34f8aacf6544 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:32.949343 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db29b24-5eff-4622-8555-a43701d8eddb admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:32.951255 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d55f45-6174-47f6-831e-1f260dca4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:32.951863 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d55f45-6174-47f6-831e-1f260dca4531 admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:32.952151 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d55f45-6174-47f6-831e-1f260dca4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:32.952424 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d55f45-6174-47f6-831e-1f260dca4531 admin admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:32.953079 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d55f45-6174-47f6-831e-1f260dca4531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:32.954327 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:32.954922 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:32.955054 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d55f45-6174-47f6-831e-1f260dca4531 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:32.955197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:32.955463 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:32.956086 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:32.957112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:04:32.957112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: warnings.warn(msg) Aug 24 10:04:32.957112 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: Aug 24 10:04:32.958302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.002917 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 575/1169] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 10:04:32 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:04:33.006810 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 595/1170] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 10:04:32 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:04:33.006947 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d55f45-6174-47f6-831e-1f260dca4531 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.008102 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.086609 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d55f45-6174-47f6-831e-1f260dca4531 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.088770 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b014d9-d847-4b71-ae9f-bf2cc5e687c8 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.091857 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.092755 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.093030 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.093299 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.093956 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.096454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:04:33.096454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: warnings.warn(msg) Aug 24 10:04:33.096454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: Aug 24 10:04:33.096841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57f97-8f08-4dcb-a0ca-24bb17398315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.096841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57f97-8f08-4dcb-a0ca-24bb17398315 admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.096841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57f97-8f08-4dcb-a0ca-24bb17398315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.097178 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.097266 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57f97-8f08-4dcb-a0ca-24bb17398315 admin admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.097402 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e57f97-8f08-4dcb-a0ca-24bb17398315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.099927 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e57f97-8f08-4dcb-a0ca-24bb17398315 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.124172 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 576/1171] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 10:04:33 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:04:33.127924 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 596/1172] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 10:04:33 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:04:33.128425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.131774 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57f97-8f08-4dcb-a0ca-24bb17398315 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.142412 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c5fbc-388a-4056-a2f0-87c362ee32dd admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.142628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57f97-8f08-4dcb-a0ca-24bb17398315 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.144204 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbec33-da57-43de-af00-5578474d3c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.144861 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbec33-da57-43de-af00-5578474d3c02 admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.145144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbec33-da57-43de-af00-5578474d3c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.145456 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbec33-da57-43de-af00-5578474d3c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.146053 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbec33-da57-43de-af00-5578474d3c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.147472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dac4f-0c29-4f17-937f-ad3736a2653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.147649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbec33-da57-43de-af00-5578474d3c02 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.148071 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dac4f-0c29-4f17-937f-ad3736a2653c admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.148349 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dac4f-0c29-4f17-937f-ad3736a2653c admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.148616 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dac4f-0c29-4f17-937f-ad3736a2653c admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.149432 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dac4f-0c29-4f17-937f-ad3736a2653c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.151042 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dac4f-0c29-4f17-937f-ad3736a2653c admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.159194 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 577/1173] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:04:33.162260 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 597/1174] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:04:33.163777 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbec33-da57-43de-af00-5578474d3c02 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.166493 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dac4f-0c29-4f17-937f-ad3736a2653c admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.174973 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbec33-da57-43de-af00-5578474d3c02 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.177638 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dac4f-0c29-4f17-937f-ad3736a2653c admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.180018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa0dd-2cfa-4ef9-8bab-b67fc1e4140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.180636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa0dd-2cfa-4ef9-8bab-b67fc1e4140e admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.180956 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa0dd-2cfa-4ef9-8bab-b67fc1e4140e admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.181225 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa0dd-2cfa-4ef9-8bab-b67fc1e4140e admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.181875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa0dd-2cfa-4ef9-8bab-b67fc1e4140e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.183259 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da9647-1f72-4e74-91c3-bc79a9b66ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.183480 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa0dd-2cfa-4ef9-8bab-b67fc1e4140e admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.183934 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9647-1f72-4e74-91c3-bc79a9b66ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.184221 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9647-1f72-4e74-91c3-bc79a9b66ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.185101 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da9647-1f72-4e74-91c3-bc79a9b66ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.185772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da9647-1f72-4e74-91c3-bc79a9b66ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.187415 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da9647-1f72-4e74-91c3-bc79a9b66ba3 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.195707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 578/1175] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:04:33.198854 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 598/1176] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:04:33.200282 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa0dd-2cfa-4ef9-8bab-b67fc1e4140e admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.203201 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da9647-1f72-4e74-91c3-bc79a9b66ba3 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.213838 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da9647-1f72-4e74-91c3-bc79a9b66ba3 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.214150 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa0dd-2cfa-4ef9-8bab-b67fc1e4140e admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.219055 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d0fd5-7acb-4dfe-a6d8-d7afb8ddedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.219686 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d0fd5-7acb-4dfe-a6d8-d7afb8ddedb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.219803 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ccc8-6f22-41c4-8b75-3bfe56dd9b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.219965 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d0fd5-7acb-4dfe-a6d8-d7afb8ddedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.220241 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d0fd5-7acb-4dfe-a6d8-d7afb8ddedb6 admin admin] PATH_INFO: `/v3/projects/950236cf63c342449f41ddc2b4e5a00f/users/b68ac5f33aa44d65916276d2e82538bd/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.220350 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ccc8-6f22-41c4-8b75-3bfe56dd9b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.220640 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ccc8-6f22-41c4-8b75-3bfe56dd9b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.220954 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ccc8-6f22-41c4-8b75-3bfe56dd9b5a admin admin] PATH_INFO: `/v3/projects/1c5af607fa5044289b343a40370ba94f/users/a6e95e46f7ad4d0288386d774f6c1298/roles/74f67ab31fb74494b29826e8e6fd77cc` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.236266 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d0fd5-7acb-4dfe-a6d8-d7afb8ddedb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950236cf63c342449f41ddc2b4e5a00f, user_id=b68ac5f33aa44d65916276d2e82538bd, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.237357 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-649d0fd5-7acb-4dfe-a6d8-d7afb8ddedb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:04:33.237357 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: warnings.warn(msg) Aug 24 10:04:33.237357 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: Aug 24 10:04:33.238013 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ccc8-6f22-41c4-8b75-3bfe56dd9b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5af607fa5044289b343a40370ba94f, user_id=a6e95e46f7ad4d0288386d774f6c1298, role_id=74f67ab31fb74494b29826e8e6fd77cc)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.239511 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d0fd5-7acb-4dfe-a6d8-d7afb8ddedb6 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.241387 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ccc8-6f22-41c4-8b75-3bfe56dd9b5a admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.257122 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 599/1177] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 10:04:33 2022] PUT /identity/v3/projects/950236cf63c342449f41ddc2b4e5a00f/users/b68ac5f33aa44d65916276d2e82538bd/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:04:33.257617 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 579/1178] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 10:04:33 2022] PUT /identity/v3/projects/1c5af607fa5044289b343a40370ba94f/users/a6e95e46f7ad4d0288386d774f6c1298/roles/74f67ab31fb74494b29826e8e6fd77cc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:04:33.262903 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0bac4-ff97-474b-a406-550f720d5845 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.263092 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aaee8-b427-4fe1-a2eb-7ec3076987cc None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.263293 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aaee8-b427-4fe1-a2eb-7ec3076987cc None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.263408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0bac4-ff97-474b-a406-550f720d5845 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.263585 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aaee8-b427-4fe1-a2eb-7ec3076987cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.263816 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0bac4-ff97-474b-a406-550f720d5845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.285251 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-6ea0bac4-ff97-474b-a406-550f720d5845 None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:33.286516 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-6ea0bac4-ff97-474b-a406-550f720d5845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:33.293027 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-d61aaee8-b427-4fe1-a2eb-7ec3076987cc None None] MFA Rules not processed for user `4e344534c0524c1e81232c0c48cd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:33.295782 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-d61aaee8-b427-4fe1-a2eb-7ec3076987cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:33.337666 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:33.347560 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:33.364768 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 600/1179] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:04:33.372557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 580/1180] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:33.375606 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0bac4-ff97-474b-a406-550f720d5845 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.377314 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-6ea0bac4-ff97-474b-a406-550f720d5845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:33.382841 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aaee8-b427-4fe1-a2eb-7ec3076987cc None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:33.384291 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-d61aaee8-b427-4fe1-a2eb-7ec3076987cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:33.459712 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0bac4-ff97-474b-a406-550f720d5845 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.463512 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac7f96-c185-40bb-a0af-0081ca8efd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.464133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7f96-c185-40bb-a0af-0081ca8efd23 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.464597 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7f96-c185-40bb-a0af-0081ca8efd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.464799 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7f96-c185-40bb-a0af-0081ca8efd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.473837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aaee8-b427-4fe1-a2eb-7ec3076987cc None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:33.476805 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac7f96-c185-40bb-a0af-0081ca8efd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.479375 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac7f96-c185-40bb-a0af-0081ca8efd23 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.480713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6751c-9f9c-4456-b6fd-d1e50d37e360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:33.484719 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6751c-9f9c-4456-b6fd-d1e50d37e360 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:33.484719 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6751c-9f9c-4456-b6fd-d1e50d37e360 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:33.484719 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6751c-9f9c-4456-b6fd-d1e50d37e360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:33.490187 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 601/1181] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:04:33.499660 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6751c-9f9c-4456-b6fd-d1e50d37e360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:33.502782 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6751c-9f9c-4456-b6fd-d1e50d37e360 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:33.518765 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 581/1182] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:04:40.631200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a4cf-db66-48fc-a241-7860df0c38f4 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:40.631772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a4cf-db66-48fc-a241-7860df0c38f4 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:40.632209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a4cf-db66-48fc-a241-7860df0c38f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:40.665579 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-cea5a4cf-db66-48fc-a241-7860df0c38f4 None None] MFA Rules not processed for user `b68ac5f33aa44d65916276d2e82538bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:40.667070 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-cea5a4cf-db66-48fc-a241-7860df0c38f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:40.762020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 602/1183] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:40 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:40.766748 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6751c-9f9c-4456-b6fd-d1e50d37e360 service neutron] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:40.777129 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6751c-9f9c-4456-b6fd-d1e50d37e360 service neutron] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:40.786301 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ac72-d89c-4659-bf7d-80c46f1a237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:40.787759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ac72-d89c-4659-bf7d-80c46f1a237b admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:40.788236 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ac72-d89c-4659-bf7d-80c46f1a237b admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:40.788514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961ac72-d89c-4659-bf7d-80c46f1a237b admin admin] PATH_INFO: `/v3/projects` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:40.789262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961ac72-d89c-4659-bf7d-80c46f1a237b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:40.791226 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961ac72-d89c-4659-bf7d-80c46f1a237b admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:40.855531 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5a4cf-db66-48fc-a241-7860df0c38f4 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:40.856250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 582/1184] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 10:04:40 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:04:40.876087 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5a4cf-db66-48fc-a241-7860df0c38f4 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.006075 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8c977-cb85-4657-8abc-99787acfb294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.006703 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c977-cb85-4657-8abc-99787acfb294 admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.006978 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c977-cb85-4657-8abc-99787acfb294 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.007248 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c977-cb85-4657-8abc-99787acfb294 admin admin] PATH_INFO: `/v3/users` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.008078 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8c977-cb85-4657-8abc-99787acfb294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.010228 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8c977-cb85-4657-8abc-99787acfb294 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.031266 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:41.043961 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 603/1185] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 10:04:40 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:04:41.044950 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ac72-d89c-4659-bf7d-80c46f1a237b admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.059022 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961ac72-d89c-4659-bf7d-80c46f1a237b admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.072525 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144a40f-a4dc-4fa1-9eb9-f18d3225d879 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.073379 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144a40f-a4dc-4fa1-9eb9-f18d3225d879 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.073660 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144a40f-a4dc-4fa1-9eb9-f18d3225d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.083514 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29986-ef89-433c-b24d-dc52676812af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.085160 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29986-ef89-433c-b24d-dc52676812af admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.087910 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29986-ef89-433c-b24d-dc52676812af admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.088392 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29986-ef89-433c-b24d-dc52676812af admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.089588 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29986-ef89-433c-b24d-dc52676812af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.092942 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29986-ef89-433c-b24d-dc52676812af admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.115497 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 583/1186] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:04:41.117165 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a144a40f-a4dc-4fa1-9eb9-f18d3225d879 None None] MFA Rules not processed for user `a6e95e46f7ad4d0288386d774f6c1298`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:41.118582 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a144a40f-a4dc-4fa1-9eb9-f18d3225d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:41.121024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29986-ef89-433c-b24d-dc52676812af admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.134501 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29986-ef89-433c-b24d-dc52676812af admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.142822 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839df38-4f48-42e0-a324-e5f8ecb945f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.143595 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839df38-4f48-42e0-a324-e5f8ecb945f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.143947 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839df38-4f48-42e0-a324-e5f8ecb945f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.144286 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839df38-4f48-42e0-a324-e5f8ecb945f6 admin admin] PATH_INFO: `/v3/projects/2208e9e039d94eb19d4de08833ba7f93/users/72abefdb05f846d6a0cb965733f625f8/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.179469 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839df38-4f48-42e0-a324-e5f8ecb945f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2208e9e039d94eb19d4de08833ba7f93, user_id=72abefdb05f846d6a0cb965733f625f8, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.182249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839df38-4f48-42e0-a324-e5f8ecb945f6 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.218869 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 584/1187] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 10:04:41 2022] PUT /identity/v3/projects/2208e9e039d94eb19d4de08833ba7f93/users/72abefdb05f846d6a0cb965733f625f8/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:04:41.223805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839df38-4f48-42e0-a324-e5f8ecb945f6 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.245642 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 604/1188] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:41 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:41.250143 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144a40f-a4dc-4fa1-9eb9-f18d3225d879 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.268628 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144a40f-a4dc-4fa1-9eb9-f18d3225d879 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.334377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839df38-4f48-42e0-a324-e5f8ecb945f6 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.341158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b0fe-044f-46f8-8372-f934cbf32adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.341910 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b0fe-044f-46f8-8372-f934cbf32adf admin admin] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.342556 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b0fe-044f-46f8-8372-f934cbf32adf admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.342927 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b0fe-044f-46f8-8372-f934cbf32adf admin admin] PATH_INFO: `/v3/roles` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.343677 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600b0fe-044f-46f8-8372-f934cbf32adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.345864 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600b0fe-044f-46f8-8372-f934cbf32adf admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.359118 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 585/1189] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:04:41.362913 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b0fe-044f-46f8-8372-f934cbf32adf admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.378710 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b0fe-044f-46f8-8372-f934cbf32adf admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.380276 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785b4e0-86df-46d2-9537-6979d687ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.382953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b4e0-86df-46d2-9537-6979d687ec9a admin admin] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.383353 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b4e0-86df-46d2-9537-6979d687ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.383735 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b4e0-86df-46d2-9537-6979d687ec9a admin admin] PATH_INFO: `/v3/projects` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.384507 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eddc8-a814-4275-8aff-cc44c6ff9649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.385426 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eddc8-a814-4275-8aff-cc44c6ff9649 admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.385561 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785b4e0-86df-46d2-9537-6979d687ec9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.385720 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eddc8-a814-4275-8aff-cc44c6ff9649 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.386002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eddc8-a814-4275-8aff-cc44c6ff9649 admin admin] PATH_INFO: `/v3/projects/2208e9e039d94eb19d4de08833ba7f93/users/72abefdb05f846d6a0cb965733f625f8/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.388524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eddc8-a814-4275-8aff-cc44c6ff9649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2208e9e039d94eb19d4de08833ba7f93, user_id=72abefdb05f846d6a0cb965733f625f8, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.390739 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785b4e0-86df-46d2-9537-6979d687ec9a admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.391292 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eddc8-a814-4275-8aff-cc44c6ff9649 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.403875 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 586/1190] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 10:04:41 2022] PUT /identity/v3/projects/2208e9e039d94eb19d4de08833ba7f93/users/72abefdb05f846d6a0cb965733f625f8/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:04:41.429986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 605/1191] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 24 10:04:41 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:04:41.435115 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eddc8-a814-4275-8aff-cc44c6ff9649 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.444690 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:41.549423 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eddc8-a814-4275-8aff-cc44c6ff9649 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.654805 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863686eb-d904-4f1a-8c5f-8acf4b807696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.655868 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863686eb-d904-4f1a-8c5f-8acf4b807696 admin admin] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.656305 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863686eb-d904-4f1a-8c5f-8acf4b807696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.656795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863686eb-d904-4f1a-8c5f-8acf4b807696 admin admin] PATH_INFO: `/v3/users` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.657924 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863686eb-d904-4f1a-8c5f-8acf4b807696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.662094 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863686eb-d904-4f1a-8c5f-8acf4b807696 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.728167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 587/1192] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 24 10:04:41 2022] POST /identity/v3/users => generated 299 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:04:41.729659 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785b4e0-86df-46d2-9537-6979d687ec9a admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.751608 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785b4e0-86df-46d2-9537-6979d687ec9a admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.757860 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a77a5-e71d-41c9-83d4-b5ddc595c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.758397 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a77a5-e71d-41c9-83d4-b5ddc595c26e admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.760726 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a77a5-e71d-41c9-83d4-b5ddc595c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.760726 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a77a5-e71d-41c9-83d4-b5ddc595c26e admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.760726 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a77a5-e71d-41c9-83d4-b5ddc595c26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.761467 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a77a5-e71d-41c9-83d4-b5ddc595c26e admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.784701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 606/1193] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:04:41.789112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863686eb-d904-4f1a-8c5f-8acf4b807696 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.802861 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863686eb-d904-4f1a-8c5f-8acf4b807696 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:41.824744 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36ff2-3ba3-44ce-aab1-6524cc32efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:41.825636 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36ff2-3ba3-44ce-aab1-6524cc32efb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:41.826023 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36ff2-3ba3-44ce-aab1-6524cc32efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:41.826397 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36ff2-3ba3-44ce-aab1-6524cc32efb6 admin admin] PATH_INFO: `/v3/projects/554f57c590824a838cf4d4de264c3cd5/users/f0fe339a440240d2af5ed8f57a174ff0/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:41.853034 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce36ff2-3ba3-44ce-aab1-6524cc32efb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554f57c590824a838cf4d4de264c3cd5, user_id=f0fe339a440240d2af5ed8f57a174ff0, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:41.857538 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce36ff2-3ba3-44ce-aab1-6524cc32efb6 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:41.879413 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 588/1194] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 10:04:41 2022] PUT /identity/v3/projects/554f57c590824a838cf4d4de264c3cd5/users/f0fe339a440240d2af5ed8f57a174ff0/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:04:41.883588 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a77a5-e71d-41c9-83d4-b5ddc595c26e admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:41.901692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a77a5-e71d-41c9-83d4-b5ddc595c26e admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:42.013925 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e18dd7-270c-49d3-9d17-98bc27e30c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:42.016388 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e18dd7-270c-49d3-9d17-98bc27e30c7f admin admin] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:42.017168 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e18dd7-270c-49d3-9d17-98bc27e30c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:42.017168 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e18dd7-270c-49d3-9d17-98bc27e30c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:42.018043 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e18dd7-270c-49d3-9d17-98bc27e30c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:42.019978 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e18dd7-270c-49d3-9d17-98bc27e30c7f admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:42.022888 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:42.036970 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 607/1195] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:04:42.040408 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36ff2-3ba3-44ce-aab1-6524cc32efb6 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:42.053009 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36ff2-3ba3-44ce-aab1-6524cc32efb6 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:42.058358 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:42.059325 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] REQUEST_METHOD: `PUT` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:42.059711 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:42.060119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] PATH_INFO: `/v3/projects/554f57c590824a838cf4d4de264c3cd5/users/f0fe339a440240d2af5ed8f57a174ff0/roles/e1d977f275a8474ea050e57e76d6e7e0` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:42.062425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554f57c590824a838cf4d4de264c3cd5, user_id=f0fe339a440240d2af5ed8f57a174ff0, role_id=e1d977f275a8474ea050e57e76d6e7e0)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:42.065389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:42.098304 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 589/1196] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 24 10:04:42 2022] PUT /identity/v3/projects/554f57c590824a838cf4d4de264c3cd5/users/f0fe339a440240d2af5ed8f57a174ff0/roles/e1d977f275a8474ea050e57e76d6e7e0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:04:47.891222 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc010b-88bc-4ada-9a01-46eb65fbe15d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:47.891825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc010b-88bc-4ada-9a01-46eb65fbe15d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:47.892169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc010b-88bc-4ada-9a01-46eb65fbe15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:47.930027 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-45bc010b-88bc-4ada-9a01-46eb65fbe15d None None] MFA Rules not processed for user `72abefdb05f846d6a0cb965733f625f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:47.931635 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-45bc010b-88bc-4ada-9a01-46eb65fbe15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:48.046419 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:48.048643 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 608/1197] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:47 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:48.049830 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:48.181868 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99eb04-a422-45b0-8381-84a6bce6a549 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:48.188569 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179996d-7cd9-47c3-bb9a-3fb43514dcdf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9039bb844c14a8789c6f30e461f77c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:48.192801 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179996d-7cd9-47c3-bb9a-3fb43514dcdf service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:48.192801 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179996d-7cd9-47c3-bb9a-3fb43514dcdf service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:48.194864 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179996d-7cd9-47c3-bb9a-3fb43514dcdf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:48.202170 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:48.294864 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179996d-7cd9-47c3-bb9a-3fb43514dcdf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:48.296003 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179996d-7cd9-47c3-bb9a-3fb43514dcdf service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:48.313028 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 590/1198] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:48 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:04:48.471499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e837f8c-00a7-484a-8371-988287ce664c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:48.472149 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e837f8c-00a7-484a-8371-988287ce664c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:48.472569 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e837f8c-00a7-484a-8371-988287ce664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:48.514688 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-2e837f8c-00a7-484a-8371-988287ce664c None None] MFA Rules not processed for user `f0fe339a440240d2af5ed8f57a174ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:48.515918 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-2e837f8c-00a7-484a-8371-988287ce664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:48.615898 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 609/1199] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:48 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:48.628775 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179996d-7cd9-47c3-bb9a-3fb43514dcdf service glance] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:48.637919 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179996d-7cd9-47c3-bb9a-3fb43514dcdf service glance] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:48.641806 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c763b-3990-4e34-ac40-5e75cd6f291e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9039bb844c14a8789c6f30e461f77c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:48.642684 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c763b-3990-4e34-ac40-5e75cd6f291e service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:48.642935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c763b-3990-4e34-ac40-5e75cd6f291e service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:48.643312 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c763b-3990-4e34-ac40-5e75cd6f291e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:48.722816 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c763b-3990-4e34-ac40-5e75cd6f291e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:48.724477 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c763b-3990-4e34-ac40-5e75cd6f291e service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:48.737303 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 591/1200] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:48 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:56.896406 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c566f50-9d4f-4198-9d95-0dca696b762d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:56.896893 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c566f50-9d4f-4198-9d95-0dca696b762d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:56.897267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c566f50-9d4f-4198-9d95-0dca696b762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:56.941429 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-0c566f50-9d4f-4198-9d95-0dca696b762d None None] MFA Rules not processed for user `a6e95e46f7ad4d0288386d774f6c1298`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:56.944267 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-0c566f50-9d4f-4198-9d95-0dca696b762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:56.957158 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 610/1201] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:04:56 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:57.276625 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95278d17-6df8-4eb8-9939-6ac837fa4fb7 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:57.277498 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95278d17-6df8-4eb8-9939-6ac837fa4fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:57.277498 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95278d17-6df8-4eb8-9939-6ac837fa4fb7 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:57.278671 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 592/1202] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 24 10:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:04:57.284973 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ef12c-7d4a-4212-b244-581f81c04e6c None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:57.285292 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ef12c-7d4a-4212-b244-581f81c04e6c None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:57.285557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ef12c-7d4a-4212-b244-581f81c04e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:57.319526 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-480ef12c-7d4a-4212-b244-581f81c04e6c None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:57.321401 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-480ef12c-7d4a-4212-b244-581f81c04e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:57.379510 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=100 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:57.399750 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 611/1203] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 24 10:04:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:04:57.405597 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5705225-df9c-4591-91d4-a5cbde1a2ecb None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:57.406090 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5705225-df9c-4591-91d4-a5cbde1a2ecb None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:57.406368 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5705225-df9c-4591-91d4-a5cbde1a2ecb None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:57.407911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 593/1204] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 24 10:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:04:57.422495 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30c0cb-6665-4d64-8ffe-e9692a6b8e4a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:57.422788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30c0cb-6665-4d64-8ffe-e9692a6b8e4a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:57.423063 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30c0cb-6665-4d64-8ffe-e9692a6b8e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:57.443057 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-9f30c0cb-6665-4d64-8ffe-e9692a6b8e4a None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:57.444204 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-9f30c0cb-6665-4d64-8ffe-e9692a6b8e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:57.453894 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 612/1205] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 24 10:04:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:57.467623 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5705225-df9c-4591-91d4-a5cbde1a2ecb None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:57.469689 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-f5705225-df9c-4591-91d4-a5cbde1a2ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:57.493063 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5705225-df9c-4591-91d4-a5cbde1a2ecb None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:57.496795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df6cdb-c7e4-4920-86e3-dd5395270132 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9039bb844c14a8789c6f30e461f77c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:57.501088 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cdb-c7e4-4920-86e3-dd5395270132 service glance] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:57.504709 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cdb-c7e4-4920-86e3-dd5395270132 service glance] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:57.505070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cdb-c7e4-4920-86e3-dd5395270132 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:57.518070 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df6cdb-c7e4-4920-86e3-dd5395270132 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:57.520731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df6cdb-c7e4-4920-86e3-dd5395270132 service glance] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:57.539717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 594/1206] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:57.931180 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f24835-97d8-43ff-a0e1-1559e3ff0140 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:57.931825 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f24835-97d8-43ff-a0e1-1559e3ff0140 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:57.932950 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f24835-97d8-43ff-a0e1-1559e3ff0140 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:57.934398 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 613/1207] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 24 10:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:04:57.941756 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c56701-50ec-4718-8474-66b7ddfda317 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:57.942105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c56701-50ec-4718-8474-66b7ddfda317 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:57.942443 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c56701-50ec-4718-8474-66b7ddfda317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:57.964795 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-d2c56701-50ec-4718-8474-66b7ddfda317 None None] MFA Rules not processed for user `b7495e57630d4978a2a5c1681b8578c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:57.967693 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-d2c56701-50ec-4718-8474-66b7ddfda317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:58.059184 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 595/1208] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 24 10:04:57 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:58.070520 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f24835-97d8-43ff-a0e1-1559e3ff0140 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:58.083230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f24835-97d8-43ff-a0e1-1559e3ff0140 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:58.087624 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4f5da-77d9-4f7a-a51e-f65028251ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:58.088459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4f5da-77d9-4f7a-a51e-f65028251ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.089385 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4f5da-77d9-4f7a-a51e-f65028251ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.089878 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4f5da-77d9-4f7a-a51e-f65028251ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.107989 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4f5da-77d9-4f7a-a51e-f65028251ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:58.109585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4f5da-77d9-4f7a-a51e-f65028251ee9 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:58.118916 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 614/1209] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:58 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:58.574386 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d81fc-852d-4eaf-aca5-6d769ef2fd44 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.574984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d81fc-852d-4eaf-aca5-6d769ef2fd44 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.574984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d81fc-852d-4eaf-aca5-6d769ef2fd44 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.577607 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 596/1210] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 24 10:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:04:58.585905 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777ed1-d17e-4ccc-b259-89260d275e4a None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.586990 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777ed1-d17e-4ccc-b259-89260d275e4a None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.587276 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777ed1-d17e-4ccc-b259-89260d275e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.617034 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-4f777ed1-d17e-4ccc-b259-89260d275e4a None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:58.618437 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-4f777ed1-d17e-4ccc-b259-89260d275e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:58.634440 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01ce40-0dc1-431b-970f-e3d635129c88 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.634904 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01ce40-0dc1-431b-970f-e3d635129c88 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.635335 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01ce40-0dc1-431b-970f-e3d635129c88 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.636865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 615/1211] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 24 10:04:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:58.642009 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627a0f-5bc6-481f-8901-1be28e4f2f59 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.642124 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627a0f-5bc6-481f-8901-1be28e4f2f59 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.642402 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627a0f-5bc6-481f-8901-1be28e4f2f59 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.643856 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 597/1212] 10.222.0.70 () {54 vars in 961 bytes} [Wed Aug 24 10:04:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:04:58.644075 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 616/1213] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 24 10:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:04:58.649870 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6beae-d905-4634-9f9d-1377673b03b9 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.650293 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6beae-d905-4634-9f9d-1377673b03b9 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.650635 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6beae-d905-4634-9f9d-1377673b03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.651459 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082b73-044e-4268-8db0-c8f9f66aa38d None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.651946 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082b73-044e-4268-8db0-c8f9f66aa38d None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.652457 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50082b73-044e-4268-8db0-c8f9f66aa38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.679743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-52d6beae-d905-4634-9f9d-1377673b03b9 None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:58.681014 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-52d6beae-d905-4634-9f9d-1377673b03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:58.686876 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-50082b73-044e-4268-8db0-c8f9f66aa38d None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:58.689040 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-50082b73-044e-4268-8db0-c8f9f66aa38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:58.705012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 617/1214] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 24 10:04:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:04:58.717986 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50082b73-044e-4268-8db0-c8f9f66aa38d None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:58.727911 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=100 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:58.734759 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50082b73-044e-4268-8db0-c8f9f66aa38d None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:58.740760 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe914d-d172-482a-8e40-c9578b9601a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:58.741557 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe914d-d172-482a-8e40-c9578b9601a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.741971 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe914d-d172-482a-8e40-c9578b9601a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.742345 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe914d-d172-482a-8e40-c9578b9601a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.757133 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe914d-d172-482a-8e40-c9578b9601a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:58.757663 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe914d-d172-482a-8e40-c9578b9601a8 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:58.771407 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 618/1215] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:04:58.782827 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 598/1216] 10.222.0.70 () {58 vars in 1058 bytes} [Wed Aug 24 10:04:58 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:58.797376 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe914d-d172-482a-8e40-c9578b9601a8 service neutron] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:58.812105 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe914d-d172-482a-8e40-c9578b9601a8 service neutron] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:58.821799 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520fac97915740c38318e2a8664cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:58.824014 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:58.825948 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:58.826910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:58.832612 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:58.853048 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:58.854707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:58.876509 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 619/1217] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:58 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:08.768144 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=10 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:08.867471 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=33 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:10.697872 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e153e-bd62-4b95-bf5d-73cf8ca142d5 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:10.698811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e153e-bd62-4b95-bf5d-73cf8ca142d5 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:10.698811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e153e-bd62-4b95-bf5d-73cf8ca142d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:10.720563 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-be7e153e-bd62-4b95-bf5d-73cf8ca142d5 None None] MFA Rules not processed for user `b7495e57630d4978a2a5c1681b8578c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:10.721808 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-be7e153e-bd62-4b95-bf5d-73cf8ca142d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:10.731731 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 599/1218] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Aug 24 10:05:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:05:10.745209 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:10.755613 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3fdc0-c933-458f-bf5e-4086607ded86 service placement] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:10.759288 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9ce1-162f-4238-8502-de156f7688a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:10.759886 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9ce1-162f-4238-8502-de156f7688a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:10.760169 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9ce1-162f-4238-8502-de156f7688a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:10.760434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9ce1-162f-4238-8502-de156f7688a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:10.768512 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b9ce1-162f-4238-8502-de156f7688a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:10.770135 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b9ce1-162f-4238-8502-de156f7688a3 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:10.779039 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 620/1219] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:11.795097 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ff12-77d2-46c8-8b0c-3b2731bcdd98 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:11.795683 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ff12-77d2-46c8-8b0c-3b2731bcdd98 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:11.795825 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ff12-77d2-46c8-8b0c-3b2731bcdd98 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:11.797186 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 600/1220] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 10:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:05:11.804008 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54fba-7f8d-40bb-8984-da1093fe8650 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:11.804885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54fba-7f8d-40bb-8984-da1093fe8650 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:11.804885 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54fba-7f8d-40bb-8984-da1093fe8650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:11.841197 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-f3e54fba-7f8d-40bb-8984-da1093fe8650 None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:11.842967 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-f3e54fba-7f8d-40bb-8984-da1093fe8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:11.855280 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 621/1221] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 10:05:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:05:11.875434 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ff12-77d2-46c8-8b0c-3b2731bcdd98 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:11.892189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ff12-77d2-46c8-8b0c-3b2731bcdd98 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:11.898619 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b382a0-74f9-4523-8bb9-2122c258d631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:11.899547 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b382a0-74f9-4523-8bb9-2122c258d631 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:11.899953 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b382a0-74f9-4523-8bb9-2122c258d631 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:11.900328 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b382a0-74f9-4523-8bb9-2122c258d631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:11.918189 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b382a0-74f9-4523-8bb9-2122c258d631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:11.920607 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b382a0-74f9-4523-8bb9-2122c258d631 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:11.944159 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 601/1222] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:18.247594 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b72646-d992-4685-b376-74b91b5f3c57 None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:18.248601 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b72646-d992-4685-b376-74b91b5f3c57 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:18.248912 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b72646-d992-4685-b376-74b91b5f3c57 None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:18.250303 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 622/1223] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 10:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:05:18.259198 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206b7f-4249-4db6-a841-d44eb07ebf60 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:18.259732 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206b7f-4249-4db6-a841-d44eb07ebf60 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:18.259732 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206b7f-4249-4db6-a841-d44eb07ebf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:18.279794 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-f6206b7f-4249-4db6-a841-d44eb07ebf60 None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:18.281265 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-f6206b7f-4249-4db6-a841-d44eb07ebf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:18.291553 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 602/1224] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 10:05:18 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:18.306192 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b72646-d992-4685-b376-74b91b5f3c57 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:18.330013 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b72646-d992-4685-b376-74b91b5f3c57 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:18.335225 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0f815-401d-47f0-9e7b-3a9dcf23a520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:18.335977 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f815-401d-47f0-9e7b-3a9dcf23a520 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:18.336328 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f815-401d-47f0-9e7b-3a9dcf23a520 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:18.336692 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0f815-401d-47f0-9e7b-3a9dcf23a520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:18.346995 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0f815-401d-47f0-9e7b-3a9dcf23a520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:18.348577 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0f815-401d-47f0-9e7b-3a9dcf23a520 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:18.360926 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 623/1225] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:28.274921 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=12 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:28.356437 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=15 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:32.365502 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6206b7f-4249-4db6-a841-d44eb07ebf60 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:32.374932 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6206b7f-4249-4db6-a841-d44eb07ebf60 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:32.378513 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab11284-2290-4052-9349-1821e1435213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:32.379119 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11284-2290-4052-9349-1821e1435213 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:32.379401 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11284-2290-4052-9349-1821e1435213 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:32.379676 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11284-2290-4052-9349-1821e1435213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:32.389394 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab11284-2290-4052-9349-1821e1435213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:32.390835 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab11284-2290-4052-9349-1821e1435213 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:32.400922 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 603/1226] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:32 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:42.396141 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=6 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:50.430472 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f0fa-65e0-4eb7-aceb-5314ad5ff172 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:50.431084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f0fa-65e0-4eb7-aceb-5314ad5ff172 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:50.431084 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f0fa-65e0-4eb7-aceb-5314ad5ff172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:50.450720 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-cf84f0fa-65e0-4eb7-aceb-5314ad5ff172 None None] MFA Rules not processed for user `b68ac5f33aa44d65916276d2e82538bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:50.451982 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-cf84f0fa-65e0-4eb7-aceb-5314ad5ff172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:50.459279 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 624/1227] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:05:50 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:50.807436 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f805f-2ea4-4b8f-9132-c5a3bc048b60 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:50.807976 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f805f-2ea4-4b8f-9132-c5a3bc048b60 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:50.808086 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f805f-2ea4-4b8f-9132-c5a3bc048b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:50.827916 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6f7f805f-2ea4-4b8f-9132-c5a3bc048b60 None None] MFA Rules not processed for user `b7495e57630d4978a2a5c1681b8578c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:50.829167 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6f7f805f-2ea4-4b8f-9132-c5a3bc048b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:50.835709 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 604/1228] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 24 10:05:50 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:50.847949 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f0fa-65e0-4eb7-aceb-5314ad5ff172 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:50.857581 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f0fa-65e0-4eb7-aceb-5314ad5ff172 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:50.861286 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919c4a3-4b8f-450f-aff7-1b0aab7ad6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:50.861894 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c4a3-4b8f-450f-aff7-1b0aab7ad6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:50.862176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c4a3-4b8f-450f-aff7-1b0aab7ad6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:50.862445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c4a3-4b8f-450f-aff7-1b0aab7ad6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:50.869895 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919c4a3-4b8f-450f-aff7-1b0aab7ad6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:50.871323 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919c4a3-4b8f-450f-aff7-1b0aab7ad6f2 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:50.879559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 625/1229] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:50 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:00.822419 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:00.875989 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=9 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:16.041555 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8691-1de8-42ad-8c15-e2ad6097baf8 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:16.042044 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8691-1de8-42ad-8c15-e2ad6097baf8 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:16.042129 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d8691-1de8-42ad-8c15-e2ad6097baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:16.060218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-a26d8691-1de8-42ad-8c15-e2ad6097baf8 None None] MFA Rules not processed for user `b68ac5f33aa44d65916276d2e82538bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:16.061420 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a26d8691-1de8-42ad-8c15-e2ad6097baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:16.068523 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 605/1230] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:06:16 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:06:26.055250 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:31.901539 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f1722-f6ea-4f89-8730-b95c53b3fb32 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:31.902038 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f1722-f6ea-4f89-8730-b95c53b3fb32 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:31.902137 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f1722-f6ea-4f89-8730-b95c53b3fb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:31.921418 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a02f1722-f6ea-4f89-8730-b95c53b3fb32 None None] MFA Rules not processed for user `b68ac5f33aa44d65916276d2e82538bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:31.922689 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a02f1722-f6ea-4f89-8730-b95c53b3fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:31.930243 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 626/1231] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:06:31 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:41.916445 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:31.968284 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e1e8-162b-4df5-99f5-c777c88e92e0 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:31.968811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e1e8-162b-4df5-99f5-c777c88e92e0 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:31.968906 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e1e8-162b-4df5-99f5-c777c88e92e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:31.987692 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-6166e1e8-162b-4df5-99f5-c777c88e92e0 None None] MFA Rules not processed for user `b68ac5f33aa44d65916276d2e82538bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:31.989002 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-6166e1e8-162b-4df5-99f5-c777c88e92e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:31.996360 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 606/1232] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:07:31 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:41.982739 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=3 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:45.963854 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f1722-f6ea-4f89-8730-b95c53b3fb32 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:45.983002 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f1722-f6ea-4f89-8730-b95c53b3fb32 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:45.986435 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838e97c-53e9-4f5b-a8d5-e08228316627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:45.987027 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838e97c-53e9-4f5b-a8d5-e08228316627 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:45.987302 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838e97c-53e9-4f5b-a8d5-e08228316627 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:45.987571 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838e97c-53e9-4f5b-a8d5-e08228316627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:45.996290 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838e97c-53e9-4f5b-a8d5-e08228316627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:45.997731 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838e97c-53e9-4f5b-a8d5-e08228316627 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.007103 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 627/1233] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:45 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:56.003042 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=10 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:44.986350 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166e1e8-162b-4df5-99f5-c777c88e92e0 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:45.008355 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166e1e8-162b-4df5-99f5-c777c88e92e0 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:45.013333 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00785c56-5f97-4cc0-9e07-0ecf3d1ec089 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520fac97915740c38318e2a8664cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:45.013915 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785c56-5f97-4cc0-9e07-0ecf3d1ec089 service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:45.014192 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785c56-5f97-4cc0-9e07-0ecf3d1ec089 service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:45.014462 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785c56-5f97-4cc0-9e07-0ecf3d1ec089 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:45.022680 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00785c56-5f97-4cc0-9e07-0ecf3d1ec089 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:45.024241 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00785c56-5f97-4cc0-9e07-0ecf3d1ec089 service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:45.033811 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 607/1234] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:44 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:55.029904 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=10 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:52.611592 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838e97c-53e9-4f5b-a8d5-e08228316627 service neutron] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:09:52.634377 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838e97c-53e9-4f5b-a8d5-e08228316627 service neutron] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:09:52.640052 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c04f-7128-4edb-b377-ffccb5e7a4a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:09:52.640696 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c04f-7128-4edb-b377-ffccb5e7a4a0 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:09:52.640980 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c04f-7128-4edb-b377-ffccb5e7a4a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:09:52.641253 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c04f-7128-4edb-b377-ffccb5e7a4a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:09:52.650428 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905c04f-7128-4edb-b377-ffccb5e7a4a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:09:52.652238 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905c04f-7128-4edb-b377-ffccb5e7a4a0 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:09:52.663953 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 628/1235] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:09:52 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:09:56.531963 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd437d1-37a9-4cc4-8876-40ea6bc10548 None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:09:56.532478 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd437d1-37a9-4cc4-8876-40ea6bc10548 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:09:56.532583 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd437d1-37a9-4cc4-8876-40ea6bc10548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:09:56.554569 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-3fd437d1-37a9-4cc4-8876-40ea6bc10548 None None] MFA Rules not processed for user `b68ac5f33aa44d65916276d2e82538bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:09:56.555847 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-3fd437d1-37a9-4cc4-8876-40ea6bc10548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:09:56.565627 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 608/1236] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:09:56 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:09:57.696545 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c04f-7128-4edb-b377-ffccb5e7a4a0 service nova] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:09:57.706701 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c04f-7128-4edb-b377-ffccb5e7a4a0 service nova] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:09:57.710913 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefcb94-e43a-466c-b57f-2a7098119385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:09:57.711634 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefcb94-e43a-466c-b57f-2a7098119385 service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:09:57.711915 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefcb94-e43a-466c-b57f-2a7098119385 service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:09:57.712190 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefcb94-e43a-466c-b57f-2a7098119385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:09:57.723076 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefcb94-e43a-466c-b57f-2a7098119385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:09:57.724499 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefcb94-e43a-466c-b57f-2a7098119385 service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:09:57.736006 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 629/1237] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:09:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:02.457500 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd437d1-37a9-4cc4-8876-40ea6bc10548 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:02.467943 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd437d1-37a9-4cc4-8876-40ea6bc10548 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:02.471538 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a946ad5-b690-43f6-9abd-084793f7a4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:02.472138 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a946ad5-b690-43f6-9abd-084793f7a4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:02.472416 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a946ad5-b690-43f6-9abd-084793f7a4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:02.472713 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a946ad5-b690-43f6-9abd-084793f7a4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:02.483001 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a946ad5-b690-43f6-9abd-084793f7a4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:02.484448 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a946ad5-b690-43f6-9abd-084793f7a4a7 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:02.494520 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 609/1238] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:02 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:07.730450 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=16 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:09.633352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefcb94-e43a-466c-b57f-2a7098119385 service neutron] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:09.643928 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefcb94-e43a-466c-b57f-2a7098119385 service neutron] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:09.650179 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e99f9-fbd5-4352-8699-5656721396b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:09.650790 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e99f9-fbd5-4352-8699-5656721396b7 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:09.651407 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e99f9-fbd5-4352-8699-5656721396b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:09.651797 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e99f9-fbd5-4352-8699-5656721396b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:09.660809 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e99f9-fbd5-4352-8699-5656721396b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:09.662415 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e99f9-fbd5-4352-8699-5656721396b7 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:09.673200 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 630/1239] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:09 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:12.490443 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=9 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:12.862105 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd6b6-5001-46be-b226-508749558d95 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:12.862487 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd6b6-5001-46be-b226-508749558d95 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:12.862828 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd6b6-5001-46be-b226-508749558d95 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:12.866288 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 610/1240] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 10:10:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:10:12.871847 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e26b5-061f-4c89-b876-19c846f4985b None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:12.872356 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e26b5-061f-4c89-b876-19c846f4985b None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:12.872782 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e26b5-061f-4c89-b876-19c846f4985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:12.952559 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-a61e26b5-061f-4c89-b876-19c846f4985b None None] MFA Rules not processed for user `61b8da64c241441d986c7c11f3fe2e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:10:12.954010 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-a61e26b5-061f-4c89-b876-19c846f4985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:12.964489 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 631/1241] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 10:10:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:10:12.980178 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fd6b6-5001-46be-b226-508749558d95 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:13.004318 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fd6b6-5001-46be-b226-508749558d95 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:13.032036 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69c9e-c3df-4925-9ebc-407d4c592e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:13.034286 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69c9e-c3df-4925-9ebc-407d4c592e67 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:13.036507 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69c9e-c3df-4925-9ebc-407d4c592e67 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:13.037115 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69c9e-c3df-4925-9ebc-407d4c592e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:13.057400 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb69c9e-c3df-4925-9ebc-407d4c592e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:13.063018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb69c9e-c3df-4925-9ebc-407d4c592e67 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:13.089645 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 611/1242] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:13.231176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e26b5-061f-4c89-b876-19c846f4985b None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:13.254486 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e26b5-061f-4c89-b876-19c846f4985b None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:13.260700 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc14471-3af8-42a1-b6fd-1a113d186dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:13.261426 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14471-3af8-42a1-b6fd-1a113d186dbc service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:13.261707 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14471-3af8-42a1-b6fd-1a113d186dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:13.262004 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14471-3af8-42a1-b6fd-1a113d186dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:13.291813 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc14471-3af8-42a1-b6fd-1a113d186dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:13.293621 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc14471-3af8-42a1-b6fd-1a113d186dbc service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:13.305587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 632/1243] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:13 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:17.764757 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69c9e-c3df-4925-9ebc-407d4c592e67 service nova] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:17.776524 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69c9e-c3df-4925-9ebc-407d4c592e67 service nova] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:17.782798 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba12ad3-e020-47ab-a7a6-569e1d5d3a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:17.783425 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba12ad3-e020-47ab-a7a6-569e1d5d3a79 service nova] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:17.783740 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba12ad3-e020-47ab-a7a6-569e1d5d3a79 service nova] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:17.784020 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba12ad3-e020-47ab-a7a6-569e1d5d3a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:17.794130 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba12ad3-e020-47ab-a7a6-569e1d5d3a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:17.795891 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba12ad3-e020-47ab-a7a6-569e1d5d3a79 service nova] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:17.807115 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 612/1244] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:17 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:23.299910 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=25 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:25.834794 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7559f3-31e8-4d15-8f34-ead91b4d8577 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:25.835407 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7559f3-31e8-4d15-8f34-ead91b4d8577 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:25.835407 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7559f3-31e8-4d15-8f34-ead91b4d8577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:25.855062 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-ac7559f3-31e8-4d15-8f34-ead91b4d8577 None None] MFA Rules not processed for user `a6e95e46f7ad4d0288386d774f6c1298`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:10:25.856297 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-ac7559f3-31e8-4d15-8f34-ead91b4d8577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:25.863371 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 633/1245] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:10:25 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:10:26.426364 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba12ad3-e020-47ab-a7a6-569e1d5d3a79 service nova] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:26.440927 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba12ad3-e020-47ab-a7a6-569e1d5d3a79 service nova] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:26.446191 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee12a5a-d7fc-48c9-9360-74b45fc0fac1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520fac97915740c38318e2a8664cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:26.446933 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12a5a-d7fc-48c9-9360-74b45fc0fac1 service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:26.447249 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12a5a-d7fc-48c9-9360-74b45fc0fac1 service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:26.447584 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12a5a-d7fc-48c9-9360-74b45fc0fac1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:26.457905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee12a5a-d7fc-48c9-9360-74b45fc0fac1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:26.459762 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee12a5a-d7fc-48c9-9360-74b45fc0fac1 service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:26.495649 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 613/1246] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:26 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:35.850182 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:36.495987 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=18 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:43.704647 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7559f3-31e8-4d15-8f34-ead91b4d8577 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:43.716556 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7559f3-31e8-4d15-8f34-ead91b4d8577 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:43.722270 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c9cd7-edec-4499-8ae9-8f7e565fa9c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b8da64c241441d986c7c11f3fe2e9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:43.722879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c9cd7-edec-4499-8ae9-8f7e565fa9c5 service nova] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:43.723159 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c9cd7-edec-4499-8ae9-8f7e565fa9c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:43.723434 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c9cd7-edec-4499-8ae9-8f7e565fa9c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:43.732271 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c9cd7-edec-4499-8ae9-8f7e565fa9c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:43.735363 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c9cd7-edec-4499-8ae9-8f7e565fa9c5 service nova] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:43.745496 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 634/1247] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:52.472297 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee12a5a-d7fc-48c9-9360-74b45fc0fac1 service placement] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:52.481567 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee12a5a-d7fc-48c9-9360-74b45fc0fac1 service placement] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:52.485240 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b023c-fcca-4736-914d-1309f6be1ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:52.485822 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b023c-fcca-4736-914d-1309f6be1ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:52.486103 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b023c-fcca-4736-914d-1309f6be1ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:52.486377 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b023c-fcca-4736-914d-1309f6be1ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:52.495211 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b023c-fcca-4736-914d-1309f6be1ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:52.496643 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b023c-fcca-4736-914d-1309f6be1ad6 service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:52.507405 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 614/1248] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:52 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:53.741522 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=6 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:02.503174 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=6 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:55.626587 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f218565-bf2d-4c76-8e40-b27d75eb01e5 None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:11:55.627891 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f218565-bf2d-4c76-8e40-b27d75eb01e5 None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:11:55.627891 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f218565-bf2d-4c76-8e40-b27d75eb01e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:11:55.645797 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-7f218565-bf2d-4c76-8e40-b27d75eb01e5 None None] MFA Rules not processed for user `b68ac5f33aa44d65916276d2e82538bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:11:55.647012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-7f218565-bf2d-4c76-8e40-b27d75eb01e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:11:55.654129 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 635/1249] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 24 10:11:55 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:11:55.988923 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b023c-fcca-4736-914d-1309f6be1ad6 service neutron] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:11:55.997286 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b023c-fcca-4736-914d-1309f6be1ad6 service neutron] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:11:56.001072 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39e572-5135-431d-b37c-d8f99762ca2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:11:56.001663 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39e572-5135-431d-b37c-d8f99762ca2a service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:11:56.001948 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39e572-5135-431d-b37c-d8f99762ca2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:11:56.002224 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39e572-5135-431d-b37c-d8f99762ca2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:11:56.009730 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39e572-5135-431d-b37c-d8f99762ca2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:11:56.011177 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39e572-5135-431d-b37c-d8f99762ca2a service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:11:56.019108 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 615/1250] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:11:55 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:12:05.641012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:06.015657 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=6 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:37.984085 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f218565-bf2d-4c76-8e40-b27d75eb01e5 None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:13:38.003291 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f218565-bf2d-4c76-8e40-b27d75eb01e5 None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:13:38.007352 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4c121-fd4e-436f-a298-7666f266fa9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:13:38.007941 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c121-fd4e-436f-a298-7666f266fa9d service neutron] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:38.008218 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c121-fd4e-436f-a298-7666f266fa9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:38.008495 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4c121-fd4e-436f-a298-7666f266fa9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:38.097088 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4c121-fd4e-436f-a298-7666f266fa9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:13:38.098529 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4c121-fd4e-436f-a298-7666f266fa9d service neutron] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:13:38.117586 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 636/1251] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:13:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:13:41.568195 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe0ce-fdf1-4d4a-ab39-07b611e10047 None None] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:41.568806 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe0ce-fdf1-4d4a-ab39-07b611e10047 None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:41.568905 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efe0ce-fdf1-4d4a-ab39-07b611e10047 None None] PATH_INFO: `/` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:41.570348 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 616/1252] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 10:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:13:41.581064 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b83e-e5e4-4e48-aaed-f878107a0caa None None] REQUEST_METHOD: `POST` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:41.582042 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b83e-e5e4-4e48-aaed-f878107a0caa None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:41.582217 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b83e-e5e4-4e48-aaed-f878107a0caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:41.660421 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.auth.core [None req-bfa1b83e-e5e4-4e48-aaed-f878107a0caa None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:13:41.661679 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-bfa1b83e-e5e4-4e48-aaed-f878107a0caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:13:41.680863 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 637/1253] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 10:13:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:13:41.692160 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe0ce-fdf1-4d4a-ab39-07b611e10047 None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:13:41.705429 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32efe0ce-fdf1-4d4a-ab39-07b611e10047 None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:13:41.710878 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992f90b-91cc-4883-9e1a-4f4521cafed8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520fac97915740c38318e2a8664cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:13:41.711476 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f90b-91cc-4883-9e1a-4f4521cafed8 service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:41.711747 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f90b-91cc-4883-9e1a-4f4521cafed8 service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:41.712017 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f90b-91cc-4883-9e1a-4f4521cafed8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:41.721010 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992f90b-91cc-4883-9e1a-4f4521cafed8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:13:41.723158 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992f90b-91cc-4883-9e1a-4f4521cafed8 service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:13:41.732925 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 617/1254] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:13:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:13:44.759592 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3fd07-1af4-432b-a64a-36f0813a95ae None None] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:44.760115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3fd07-1af4-432b-a64a-36f0813a95ae None None] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:44.760115 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3fd07-1af4-432b-a64a-36f0813a95ae None None] PATH_INFO: `/` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:44.761519 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 638/1255] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 24 10:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:13:44.789442 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d57a8-9839-4dc0-a3e0-c0c05412046c None None] REQUEST_METHOD: `POST` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:44.789943 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d57a8-9839-4dc0-a3e0-c0c05412046c None None] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:44.790049 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d57a8-9839-4dc0-a3e0-c0c05412046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:44.810262 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.auth.core [None req-2d5d57a8-9839-4dc0-a3e0-c0c05412046c None None] MFA Rules not processed for user `520fac97915740c38318e2a8664cc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:13:44.811641 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-2d5d57a8-9839-4dc0-a3e0-c0c05412046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:13:44.821018 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 618/1256] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 24 10:13:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:13:44.825788 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3fd07-1af4-432b-a64a-36f0813a95ae None None] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:13:44.839383 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3fd07-1af4-432b-a64a-36f0813a95ae None None] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:13:44.844320 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d57a8-9839-4dc0-a3e0-c0c05412046c None None] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:13:44.849656 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:13:44.850847 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:44.851964 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:44.852429 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] PATH_INFO: `/v3/users/a6e95e46f7ad4d0288386d774f6c1298` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:44.853691 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e95e46f7ad4d0288386d774f6c1298)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:13:44.854705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: WARNING py.warnings [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:44.854705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: warnings.warn(msg) Aug 24 10:13:44.854705 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: Aug 24 10:13:44.855566 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d57a8-9839-4dc0-a3e0-c0c05412046c None None] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:13:44.856016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:13:44.861095 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16338-4dec-4ec2-b184-ae022a93c2ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520fac97915740c38318e2a8664cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:13:44.861961 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16338-4dec-4ec2-b184-ae022a93c2ec service placement] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:44.862486 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16338-4dec-4ec2-b184-ae022a93c2ec service placement] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:44.862957 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16338-4dec-4ec2-b184-ae022a93c2ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:44.873484 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf16338-4dec-4ec2-b184-ae022a93c2ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:13:44.875219 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf16338-4dec-4ec2-b184-ae022a93c2ec service placement] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:13:44.885525 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 619/1257] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:13:44 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:13:44.926008 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:44.930081 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e95e46f7ad4d0288386d774f6c1298'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:44.930855 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e95e46f7ad4d0288386d774f6c1298'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:44.942125 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e95e46f7ad4d0288386d774f6c1298'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:44.949016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e95e46f7ad4d0288386d774f6c1298'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:44.949674 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e95e46f7ad4d0288386d774f6c1298'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:44.974065 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 639/1258] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 10:13:44 2022] DELETE /identity/v3/users/a6e95e46f7ad4d0288386d774f6c1298 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:13:45.157984 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16338-4dec-4ec2-b184-ae022a93c2ec service placement] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:13:45.169029 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16338-4dec-4ec2-b184-ae022a93c2ec service placement] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:13:45.225306 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:13:45.225935 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:45.226218 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:45.226490 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] PATH_INFO: `/v3/projects/1c5af607fa5044289b343a40370ba94f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:45.227606 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5af607fa5044289b343a40370ba94f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:13:45.228622 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: WARNING py.warnings [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:13:45.228622 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: warnings.warn(msg) Aug 24 10:13:45.228622 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: Aug 24 10:13:45.229923 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:13:45.283363 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5af607fa5044289b343a40370ba94f', 'request_id': 'req-538b79d2-0a4b-49f8-babe-15f02381a599'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.293215 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5af607fa5044289b343a40370ba94f', 'request_id': 'req-538b79d2-0a4b-49f8-babe-15f02381a599'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.300759 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5af607fa5044289b343a40370ba94f', 'request_id': 'req-538b79d2-0a4b-49f8-babe-15f02381a599'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.337024 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] The token cache is being invalidate because project 1c5af607fa5044289b343a40370ba94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:13:45.337323 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.337995 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.339796 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 620/1259] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 10:13:45 2022] DELETE /identity/v3/projects/1c5af607fa5044289b343a40370ba94f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:13:45.344262 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:13:45.347013 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:13:45.362928 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37821b50-0fb7-4a21-8aba-77ba46a723ba admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:13:45.422843 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:13:45.423475 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:45.423778 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:45.424050 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] PATH_INFO: `/v3/users/f0fe339a440240d2af5ed8f57a174ff0` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:45.425708 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0fe339a440240d2af5ed8f57a174ff0)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:13:45.427618 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:13:45.472409 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0fe339a440240d2af5ed8f57a174ff0'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.473089 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0fe339a440240d2af5ed8f57a174ff0'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.479803 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0fe339a440240d2af5ed8f57a174ff0'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.486955 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0fe339a440240d2af5ed8f57a174ff0'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.488311 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0fe339a440240d2af5ed8f57a174ff0'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.505792 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 640/1260] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 10:13:45 2022] DELETE /identity/v3/users/f0fe339a440240d2af5ed8f57a174ff0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:13:45.682992 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:13:45.684501 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:13:45.697512 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b79d2-0a4b-49f8-babe-15f02381a599 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:13:45.743827 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:45.758246 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:13:45.758871 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:45.759152 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:45.759424 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] PATH_INFO: `/v3/projects/554f57c590824a838cf4d4de264c3cd5` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:45.760537 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=554f57c590824a838cf4d4de264c3cd5)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:13:45.762575 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:13:45.807457 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554f57c590824a838cf4d4de264c3cd5', 'request_id': 'req-c84543d1-826f-4201-af3b-3784c3d375e3'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.814594 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554f57c590824a838cf4d4de264c3cd5', 'request_id': 'req-c84543d1-826f-4201-af3b-3784c3d375e3'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.819937 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554f57c590824a838cf4d4de264c3cd5', 'request_id': 'req-c84543d1-826f-4201-af3b-3784c3d375e3'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.830418 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] The token cache is being invalidate because project 554f57c590824a838cf4d4de264c3cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:13:45.830707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.831449 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:13:45.832951 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 621/1261] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 10:13:45 2022] DELETE /identity/v3/projects/554f57c590824a838cf4d4de264c3cd5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:13:53.923408 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:13:53.924838 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:13:53.968453 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:13:53.994894 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5e640-4ea0-4050-90bd-cc94d1cf0c4c admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:13:54.054841 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520fac97915740c38318e2a8664cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:13:54.055453 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:13:54.055733 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:13:54.056008 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:13:54.057753 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:13:54.069604 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:13:54.071178 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:13:54.081326 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 641/1262] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:13:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:13:55.827599 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:04.076945 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=40 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:46.072371 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:14:46.073899 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:14:46.145415 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84543d1-826f-4201-af3b-3784c3d375e3 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:14:46.148952 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7495e57630d4978a2a5c1681b8578c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:14:46.149557 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] REQUEST_METHOD: `GET` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:14:46.149840 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:14:46.150112 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:14:46.151837 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:14:46.215787 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:14:46.217511 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:14:46.227461 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 622/1263] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:14:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:14:52.834585 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:14:52.836269 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:14:52.854754 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594208e-276e-4ffc-80dd-fb0342a6e223 service placement] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:14:52.859634 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:14:52.860283 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:14:52.860564 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:14:52.860879 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] PATH_INFO: `/v3/users/b68ac5f33aa44d65916276d2e82538bd` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:14:52.876224 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68ac5f33aa44d65916276d2e82538bd)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:14:52.878210 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:14:52.934016 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68ac5f33aa44d65916276d2e82538bd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:52.934772 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68ac5f33aa44d65916276d2e82538bd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:52.943222 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68ac5f33aa44d65916276d2e82538bd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:52.952393 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68ac5f33aa44d65916276d2e82538bd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:52.953563 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68ac5f33aa44d65916276d2e82538bd'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:52.978755 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 642/1264] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 10:14:52 2022] DELETE /identity/v3/users/b68ac5f33aa44d65916276d2e82538bd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:14:53.160879 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:14:53.172717 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28345e9-2b28-4005-8ce4-d223a352736b service neutron] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:14:53.249743 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:14:53.250389 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:14:53.250668 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:14:53.250942 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] PATH_INFO: `/v3/projects/950236cf63c342449f41ddc2b4e5a00f` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:14:53.262681 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950236cf63c342449f41ddc2b4e5a00f)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:14:53.264700 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:14:53.310311 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:53.326866 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950236cf63c342449f41ddc2b4e5a00f', 'request_id': 'req-14f16730-c874-4638-9bf5-53a086603987'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.340280 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950236cf63c342449f41ddc2b4e5a00f', 'request_id': 'req-14f16730-c874-4638-9bf5-53a086603987'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.350966 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950236cf63c342449f41ddc2b4e5a00f', 'request_id': 'req-14f16730-c874-4638-9bf5-53a086603987'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.363454 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] The token cache is being invalidate because project 950236cf63c342449f41ddc2b4e5a00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:14:53.363727 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.364494 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.366011 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 623/1265] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:53 2022] DELETE /identity/v3/projects/950236cf63c342449f41ddc2b4e5a00f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:14:53.369931 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:14:53.371410 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:14:53.387097 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766708f-d34d-4fab-b90c-bda32dcf3b55 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:14:53.446588 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:14:53.448473 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:14:53.448473 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:14:53.448473 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] PATH_INFO: `/v3/users/72abefdb05f846d6a0cb965733f625f8` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:14:53.462826 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72abefdb05f846d6a0cb965733f625f8)` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:14:53.464891 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:14:53.514020 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72abefdb05f846d6a0cb965733f625f8'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.514672 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72abefdb05f846d6a0cb965733f625f8'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.519952 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:53.523438 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72abefdb05f846d6a0cb965733f625f8'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.533176 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72abefdb05f846d6a0cb965733f625f8'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.533795 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.notifications [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72abefdb05f846d6a0cb965733f625f8'} {{(pid=88306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.552191 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 643/1266] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 24 10:14:53 2022] DELETE /identity/v3/users/72abefdb05f846d6a0cb965733f625f8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:14:53.730723 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] Authenticating user token {{(pid=88305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:14:53.732182 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.fernet_utils [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:14:53.746516 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f16730-c874-4638-9bf5-53a086603987 admin admin] Validating token access rules against request {{(pid=88305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:14:53.804027 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e344534c0524c1e81232c0c48cd6c1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '928770adba0b40bd87bea18febe221ea', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:14:53.804549 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:14:53.804877 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:14:53.805156 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] PATH_INFO: `/v3/projects/2208e9e039d94eb19d4de08833ba7f93` {{(pid=88305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:14:53.815610 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2208e9e039d94eb19d4de08833ba7f93)` {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:14:53.817725 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] RBAC: Authorization granted {{(pid=88305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:14:53.865245 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2208e9e039d94eb19d4de08833ba7f93', 'request_id': 'req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.872584 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2208e9e039d94eb19d4de08833ba7f93', 'request_id': 'req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.877974 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2208e9e039d94eb19d4de08833ba7f93', 'request_id': 'req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30'} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.889588 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] The token cache is being invalidate because project 2208e9e039d94eb19d4de08833ba7f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:14:53.889877 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.890510 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG keystone.notifications [None req-6aade3d0-964f-454a-ad3b-f7d7a3d79e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:14:53.891974 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: [pid: 88305|app: 0|req: 624/1267] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 24 10:14:53 2022] DELETE /identity/v3/projects/2208e9e039d94eb19d4de08833ba7f93 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:15:03.548598 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=10,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:03.886707 dv-osbrick-836057-6-ceph devstack@keystone.service[88305]: DEBUG dbcounter [-] [88305] Writing DB stats keystone:SELECT=67,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:57.939817 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] Authenticating user token {{(pid=88306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:18:57.941247 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:18:58.019012 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbd279-f228-4613-b2f7-21178bf220e7 admin admin] Validating token access rules against request {{(pid=88306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:18:58.078238 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8173ad-b888-4b74-b065-d2183cb80df1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '520fac97915740c38318e2a8664cc4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64d42bc4e7840c194ea6c42c4b1be8e', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:18:58.078865 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8173ad-b888-4b74-b065-d2183cb80df1 service placement] REQUEST_METHOD: `GET` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:18:58.079154 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8173ad-b888-4b74-b065-d2183cb80df1 service placement] SCRIPT_NAME: `/identity` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:18:58.079425 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8173ad-b888-4b74-b065-d2183cb80df1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:18:58.081230 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.fernet_utils [None req-5e8173ad-b888-4b74-b065-d2183cb80df1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:18:58.093928 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8173ad-b888-4b74-b065-d2183cb80df1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:18:58.095542 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8173ad-b888-4b74-b065-d2183cb80df1 service placement] RBAC: Authorization granted {{(pid=88306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:18:58.105699 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: [pid: 88306|app: 0|req: 644/1268] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 24 10:18:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:19:08.101532 dv-osbrick-836057-6-ceph devstack@keystone.service[88306]: DEBUG dbcounter [-] [88306] Writing DB stats keystone:SELECT=62 {{(pid=88306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}